We're looking for an AI Quality Analyst to support live deployments of AI systems for an early-stage AI company building coordination tools for home care agencies.
This is not a passive monitoring role.
You will play a critical part in ensuring AI agents perform reliably in real-world environments, stepping in when needed, exercising sound judgment, and helping the team continuously improve system performance.You will be reviewing call transcripts and text messages generated by AI agents, escalating issues to customers and internal counterparts, and flagging edge cases that the system cannot handle on its own.
The volume is high, the timelines are tight, and the work requires someone who stays sharp under pressure and communicates clearly without needing to be told what to do next.Why You'll Want to JoinYou will be paid in USD (bi-monthly: every 15th and 30th)Paid Time Off in accordance with company policyObservance of Holidays per company guidelines100% remote setup so you can work wherever you're most productiveWork directly inside an early-stage AI company building meaningful infrastructure for the home care industryBe part of a team that moves fast and values your judgmentWhat You'll Work OnReal-Time Monitoring and QAReview live AI-driven interactions including call transcripts and text messages to ensure accuracy and quality of outcomesIdentify inconsistencies, edge cases, and failure patterns in system behaviorFlag issues proactively, including when expected system outputs are missing or delayedHuman-in-the-Loop InterventionStep in when the AI encounters ambiguity, failure cases,



or situations requiring human judgmentInterpret nuanced or incomplete inputs and determine the appropriate next step without waiting for directionRecognize when an AI interaction is no longer valid and take ownership of resolving itEscalation and CommunicationTranslate issues into clear, structured, and actionable communication for internal teams and customersCommunicate through Slack, Teams, and other platforms as neededMaintain a high standard of written and verbal English across all interactionsOperational Support and Continuous ImprovementHelp ensure smooth execution of active pilots and deploymentsSurface recurring patterns and insights to inform product and workflow improvementsDocument edge cases and support the development of processes for handling them in the futureWhat You Bring2 to 3 years of experience in operations, quality assurance, technical support, or a similar roleStrong ability to spot inconsistencies, edge cases, and failure patterns under high volumeClear and concise communicator in both written and spoken English at a professional levelComfortable making decisions in ambiguous, fast-moving environments without constant directionAble to navigate multiple communication platforms such as Slack, Teams, and SMS simultaneouslyHighly reliable and responsive with the ability to operate effectively in real-time workflowsAvailable to work 9 AM to 5 PM Eastern Time Monday through FridayNice to HaveFamiliarity with EMR or EHR systems,



training available for the right candidateExperience in a healthcare-adjacent or home care environmentSpanish or Mandarin language proficiencyBackground working at an early-stage startup or in a high-ambiguity environmentHow to ApplyPlease include:Your updated resumeA short Loom video (1 to 2 minutes) introducing yourself, describing a situation where you identified and resolved an ambiguous or unexpected problem independently, and explaining how you communicate issues clearly under time pressureOnly candidates who submit a Loom video will be moved to the next step of the hiring process.If you stay sharp under pressure, catch things others miss, and take ownership of problems before anyone asks you to, this role puts your judgment at the center of AI systems that support real home care workers every day.Application Process OverviewOur comprehensive selection process ensures we find the right fit for both you and our clients:Initial Application - Submit your application and complete our prequalifying questionsVideo Introduction - Record an video introduction to showcase your communication skills and work experienceRole-Specific Assessment - Complete a homework assignment tailored to the position (if applicable)Recruitment Interview - Initial screening with our talent teamExecutive Interview - Meet with senior leadership to discuss role alignmentClient Interview - Final interview with the client team you'd be supportingBackground & Reference Check - Professional reference verificationJob Offer - Successful candidates receive a formal offer to join the teamEach stage is designed to evaluate your fit for the role while giving you insights into our company culture and expectations.
We'll keep you informed throughout the process and provide feedback at each step.

📌 Ai Quality Analyst (Healthcare) (Xico)
🏢 Hire Overseas
📍 Xico