What if your instinct for natural conversation could directly improve how AI communicates with millions of people? We're looking for Conversation Quality Analysts to evaluate AI-generated dialogues and help ensure they feel genuinely human, helpful, and clear.
This is a fully remote, flexible contract role open to anyone with strong reading comprehension and a sharp sense for how conversation should flow. No AI, linguistics, or technical background required — if you can tell when a conversation feels off, you're already qualified.
Read and evaluate AI-generated conversations across a wide range of topics and scenarios
Rate responses for naturalness, helpfulness, tone, and contextual relevance
Identify awkward phrasing, logical inconsistencies, or responses that miss the mark
Compare multiple conversation paths and rank them by overall quality
Provide structured, detailed feedback using clear evaluation rubrics
Work independently and asynchronously on your own schedule
Who You Are
Strong reading comprehension and a natural feel for how conversations flow
Ability to assess dialogue quality objectively and explain your reasoning clearly
Detail-oriented and consistent — you apply the same standards across every evaluation
Comfortable working through large volumes of text-based content
Self-motivated and reliable when working independently
No prior AI, linguistics, or quality assurance experience required
Nice to Have
Background in writing, editing, communications, or customer-facing roles
Experience with content review, quality assurance, or critical analysis
Familiarity with AI chatbots or conversational tools as an end user
Why Join Us
Work on cutting-edge AI projects alongside leading research labs
Fully remote and adaptable — work when and where it suits you
Freelance autonomy with the structur