We're looking for an AI Quality Analyst to support live deployments of AI systems for an early-stage AI company building coordination tools for home care agencies. This is not a passive monitoring role. You will play a critical part in ensuring AI agents perform reliably in real-world environments, stepping in when needed, exercising sound judgment, and helping the team continuously improve system performance.
You will be reviewing call transcripts and text messages generated by AI agents, escalating issues to customers and internal counterparts, and flagging edge cases that the system cannot handle on its own. The volume is high, the timelines are tight, and the work requires someone who stays sharp under pressure and communicates clearly without needing to be told what to do next.
Why You'll Want to Join
- You will be paid in USD (bi-monthly: every 15th and 30th)
- Paid Time Off in accordance with company policy
- Observance of Holidays per company guidelines
- 100% remote setup so you can work wherever you're most productive
- Work directly inside an early-stage AI company building meaningful infrastructure for the home care industry
- Be part of a team that moves fast and values your judgment
What You'll Work OnReal-Time Monitoring and QA
- Review live AI-driven interactions including call transcripts and text messages to ensure accuracy and quality of outcomes
- Identify inconsistencies, edge cases, and failure patterns in system behavior
- Flag issues proactively, including when expected system outputs are missing or delayed
Human-in-the-Loop Intervention
- Step in when the AI encounters ambiguity, failure cases, or situations requiring human judgment
- Interpret nuanced or incomplete inputs and determine the appropriate next step without waiting for direction
- Recognize when an AI interaction is no longer valid and take ownership of resolving it
Escalation and Communication
- Translate issues into clear, structured, and actionable communication for intern
📌 AI Quality Analyst (México)
🏢 Hire Overseas
📍 México
Postulate a este anuncio
Muestra tus habilidades a la empresa, rellenar el formulario y deja un toque personal en la carta, ayudará el reclutador en la elección del candidato.