innodata (nasdaq: inod) is a leading data engineering company. With more than 2,000 customers and operations in 13 cities around the world, we are an ai technology solutions provider-of-choice for 4 out of 5 of the world’s biggest technology companies, as well as leading companies across financial services, insurance, technology, law, and medicine.
by combining advanced machine learning and artificial intelligence (ml/ai) technologies, a global workforce of subject matter experts, and a high-security infrastructure, we’re helping usher in the promise of ai. Innodata offers a powerful combination of both digital data solutions and easy-to-use, high-quality platforms.
our general workforce includes over 5,000 employees in the united states, canada, united kingdom, the philippines, india, sri lanka, israel and germany.
about the role:
we are seeking highly skilled and detail-oriented raters to evaluate ai-generated responses in their assigned language and locale . Raters will play a crucial role in ensuring that ai systems produce accurate, culturally relevant, and contextually sensitive outputs.
job title: ai response rater – linguistic & cultural evaluation
hourly commitment : 5-6 hours per day
ready to start from first week of september
key responsibilities:
- evaluate two ai-generated responses to prompts in the assigned language/locale.
- assess each response based on the provided rubric, focusing on:
- linguistic acceptability – grammatical accuracy, fluency, and naturalness.
- local adaptation – appropriateness of language use, idioms, and context.
- cultural sensitivity – awareness and respect for cultural norms and values.
- determine which response is overall better and provide a clear written justification for your choice.
- follow evaluation guidelines consistently to ensure high-quality and unbiased assessments.
requirements:
- native-level proficiency in spanish language/locales.
- strong knowledge of cultural nuances, context, and sensitivities of the assigned locale.
- excellent attention to detail and ability to apply rubrics systematically.
- prior experience in linguistic evaluation, annotation, or content rating is highly preferred.
- strong written communication skills for clear and well-structured justifications.
📌 Ai response rater - linguistic & cultural evaluation (Xico)
🏢 Innodata
📍 Xico