Job Title: GenAI Evaluation & Data Infrastructure
Location: Mexico (Remote)

Experience: 8 years
Openings: 1–2 engineers
Focus: GenAI/ML Evaluation, Data Pipelines, Test Infrastructure, Workspace/Document Processing
Role Overview
We are looking for engineers to build an automated evaluation platform for a PII rewriting/sanitization service. The engineer will develop a machine-interpretable Golden Dataset from human annotations and build an automated regression framework to continuously measure rewrite quality, privacy protection, and consistency.
This role is particularly suited to engineers with experience in GenAI evaluation, NLP/ML systems, data pipelines, or large-scale test infrastructure.
Key Responsibilities

· Design and implement a structured Golden Dataset representing PII ground-truth annotations.
· Build tooling to extract annotations from human-rated evaluation artifacts.
· Develop parsers/extraction pipelines across:
· Google Docs
· Google Sheets
· Google Slides
· Gmail/Email
· Google Calendar
· Google Chat

· PDF and Microsoft Office files




· Design protobuf/data schemas for machine-interpretable evaluation data.
· Build an automated evaluation/regression harness for the PII sanitization/rewrite service.
· Implement evaluation metrics including:
· PII Recall
· PII Precision

· Rewrite Consistency
· Entity-level and mention-level accuracy
· Build automated reporting and regression detection for service quality.
· Extend evaluation coverage across English, Spanish, Portuguese, Japanese, and Korean.
· Investigate opportunities to use GenAI/LLMs for evaluation, annotation validation, error analysis, and quality measurement where appropriate.
· Integrate the evaluation framework into existing engineering/test infrastructure.
· Partner with ML, privacy, data, and Workspace engineers to validate evaluation methodology and dataset quality.

Required Qualifications

· Bachelor's degree or equivalent experience in Computer Science, Engineering, or a related tech

📌 GenAI Evaluation (México)
🏢 Ampstek
📍 México