AgentOps (Artificial Intelligence Engineer)

3 days ago Be among the first 25 applicants

Get AI-powered advice on this job and more exclusive features.

You are an engineer passionate about building reliable, observable, and secure AI systems at scale. You enjoy working at the intersection of product metrics, evaluation frameworks, and production‑grade infrastructure. You are comfortable translating abstract KPIs into measurable signals, designing deployment safeguards, and ensuring AI systems behave safely, efficiently, and consistently in real‑world environments.

You thrive in fast‑paced, cloud‑native environments, value automation and rigor, and enjoy collaborating with product, engineering, and AI teams to continuously improve system quality.

Qualifications
- Bachelor’s degree in computer science, Software Engineering, Computer Engineering, or related field — or equivalent professional experience.
- Strong experience with AI/ML evaluation, metric definition, evaluation pipelines, golden datasets, and automated judge systems.
- Proficiency in observability and monitoring,



including structured logging, tracing, and OpenTelemetry.
- Solid background in CI/CD automation and modern deployment strategies (canary, blue‑green, gated deployments).
- Knowledge of AI safety practices, including PII scrubbing, deterministic guardrails, and secure handling of model inputs and outputs.
- Experience working with multi‑agent systems and translating product KPIs into measurable agent performance metrics.
- Hands‑on experience with AWS (CDK, ECS/ECR, WAF, SES, Bedrock, CloudWatch, DevOps Guru).
- Strong experience with Docker, Kubernetes, and cloud‑native tooling.
- Familiarity with Azure for identity management and basic exposure to GCP environments.
- Strong analytical thinking, attention to detail, and problem‑solving skills.
- Excellent communication skills to collaborate across product, platform, and AI teams.
- English proficiency required for collaboration with integral s

📌 AgentOps (Artificial Intelligence Engineer) (Estado de México)
🏢 Applaudo
📍 Estado de México