Conversation Quality Analyst (AI Training) About The Role What if your instinct for natural conversation could directly improve how AI communicates with millions of people? We're looking for Conversation Quality Analysts to evaluate AI-generated dialogues and help ensure they feel genuinely human, helpful, and clear. This is a fully remote, adaptable contract role open to anyone with strong reading comprehension and a sharp sense for how conversation should flow.

No AI, linguistics, or technical background required — if you can tell when a conversation feels off, you're already qualified.

Organization: Alignerr

Type: Hourly Contract

Location: Remote

Commitment: 10–40 hours/week What You'll Do Read and evaluate AI-generated conversations across a wide range of topics and scenarios

Rate responses for naturalness, helpfulness, tone, and contextual relevance

Identify awkward phrasing, logical inconsistencies, or responses that miss the mark

Compare multiple conversation paths and rank them by overall quality

Provide structured, detailed feedback using clear evaluation rubrics





Work independently and asynchronously on your own schedule Who You Are Strong reading comprehension and a natural feel for how conversations flow

Ability to assess dialogue quality objectively and explain your reasoning clearly

Detail-oriented and consistent — you apply the same standards across every evaluation

Comfortable working through large volumes of text-based content

Self-motivated and reliable when working independently

No prior AI, linguistics, or quality assurance experience required Nice to Have Background in writing, editing, communications, or customer-facing roles

Experience with content review, quality assurance, or critical analysis

Familiarity with AI chatbots or conversational tools as an end user Why Join Us Work on cutting-edge AI projects alongside leading research labs

Fully remote and flexible — work when and where it suits you

Freelance autonomy with the structure of meaningful, task-based work

Contribute to AI development that directly shapes how technology communicates with the world

Potential for ongoing work and contract extension as new projects launch

📌 Conversation Quality Analyst (México)
🏢 Alignerr
📍 México