Conversation Quality Analyst (AI Training)
About The Role
What if your instinct for natural conversation could directly influence how AI communicates with millions of people? We're looking for Conversation Quality Analysts to evaluate AI-generated dialogues and help ensure they sound human, helpful, and genuinely engaging.
This is a fully remote, flexible contract role open to anyone with strong language instincts and a sharp eye for quality. No AI, linguistics, or technical background required — just a reliable internet connection and the ability to recognize a great conversation when you see one.
- Organization: Alignerr
- Type: Hourly Contract
- Location: Remote
- Commitment: 10–40 hours/week
What You'll Do
- Read and evaluate AI-generated conversations across a wide range of topics and scenarios
- Assess responses for naturalness, helpfulness, tone, and contextual relevance
- Identify awkward phrasing, off-topic replies, logical errors, or unnatural dialogue flow
- Compare multiple conversation paths and rank them by overall quality
- Submit structured evaluations using clear, provided rating rubrics
- Work independently and asynchronously on your own schedule
Who You Are
- Strong reading comprehension and a natural feel for how good conversation flows
- Detail-oriented with a consistent, systematic approach to evaluation
- Comfortable working through large volumes of written dialogue
- Self-motivated and reliable when working independently
- No prior AI, linguistics, or content moderation experience required
Nice to Have
- Background in writing, editing, communications, or creative writing
- Experience in customer service, teaching, or any role involving communication quality
- Familiarity with AI chatbots or conversational tools as an end user
Why Join Us
- Work on cutting-edge AI projects alongside leading research labs
- Fully remote and flexible — work when and where it suits you
- Freelance autonomy with the structure of meaningful, task-based work
- Contribute to AI development that directly shapes how technology communicates with the world
- Potential for ongoing work and contract extension as new projects launch
