About The Role
What if your instinct for natural conversation could directly improve how AI communicates with millions of people? We're looking for Conversation Quality Analysts to evaluate AI-generated dialogues and help ensure they feel genuinely human, helpful, and clear. This is a fully remote, flexible contract role open to anyone with strong reading comprehension and a sharp sense for how conversation should flow. No AI, linguistics, or technical background required — if you can tell when a conversation feels off, you're already qualified.
• Organization: Alignerr
• Type: Hourly Contract
•
Location:
Remote
• Commitment: 10–40 hours/week
What You'll Do
• Read and evaluate AI-generated conversations across a wide range of topics and scenarios
• Rate responses for naturalness, helpfulness, tone, and contextual relevance
• Identify awkward phrasing, logical inconsistencies, or responses that miss the mark
• Compare multiple conversation paths and rank them by overall quality
• Provide structured, detailed feedback using clear evaluation rubrics
• Work independently and asynchronously on your own schedule Who You Are
• Strong reading comprehension and a natural feel for how conversations flow
• Ability to assess dialogue quality objectively and explain your reasoning clearly
• Detail-oriented and consistent — you apply the same standards across every evaluation
• Comfortable working through large volumes of text-based content
• Self-motivated and reliable when working independently
• No prior AI, linguistics, or quality assurance experience required Nice to Have
• Background in writing, editing, communications, or customer-facing roles
• Experience with content review, quality assurance, or critical analysis
• Familiarity with AI chatbots or conversational tools as an end user Why Join Us
• Work on cutting-edge AI projects alongside leading research labs
• Fully remote and adaptable — work when and where it suits you
• Freelance autonomy with the structure of meaningful, task-based work
• Contribute to AI development that directly shapes how technology communicates with the world
• Potential for ongoing work and contract extension as new projects launch