EPAM is a leading integral provider of digital platform engineering and development services. We are committed to having a positive impact on our customers, our employees, and our communities. We embrace a dynamic and inclusive culture.

Here you will collaborate with multi-national teams, contribute to a myriad of innovative projects that deliver the most creative and cutting-edge solutions, and have an opportunity to continuously learn and grow. No matter where you are located, you will join a dedicated, creative, and diverse community that will help you discover your fullest potential.

We are looking for a Senior AI OPS Engineer to help build an Enterprise AI Gateway from scratch. It is the one door every team in the company goes through to use large language models. It is also how we keep AI under control at this scale: who can use which models, what it costs and what gets logged.

The aim is that it runs itself, with onboarding of teams, agents and MCP servers, along with keys, permissions, limits and guardrails, handled by automation rather than tickets. Very little of it exists yet, so you will shape it from the very first design decision. The team is small and focused, so decisions do not take long and your work is visible.

We are looking for someone who automates by default, and who cares about the governance side of AI as much as the models themselves.

Responsibilities

- Build self-service onboarding for teams and agents, from request to working access

- Automate key provisioning, rotation and permission changes

- Adapt rate limits and quotas as usage grows

- Roll out and configure models: Vertex AI endpoints, vendor fallbacks, Model Armor

- Run MCP servers behind the gateway, under the same rules as models

- Write Python extensions that connect the gateway to other enterprise systems

- Manage the whole platform as code with Terraform, Helm and Jenkins





- Keep production healthy: availability, latency and cost, watched by alerts

- Support the teams using it, and turn every repeat question into automation

Requirements

- 3+ years of experience in Python for automation, extensions and integrations

- 3+ years of experience in SRE, with real experience keeping production systems healthy

- Deep expertise in Kubernetes, preferably on GKE

- Hands-on experience with Google Vertex AI, especially endpoints for model serving and Model Armor

- Proficiency in Terraform, Helm and CI/CD with Jenkins

- Working knowledge of GenAI/Agentic AI concepts (patterns, frameworks, protocols)

- Production experience with an AI gateway (LiteLLM, EPAM DIAL or similar) is highly appreciated

- Very good communication skills, with the ability to explain things clearly to teams using the platform every day

- English proficiency at B2 level or higher

Nice to have

- Familiarity with GCP beyond GKE and Vertex AI (BigQuery, Cloud Run, IAM)

- Experience building AI agents, for example with Google's Agent Development Kit (ADK)

- Experience with AWS Bedrock

We offer

- International projects with top brands

- Work with global teams of highly skilled, diverse peers

- Healthcare benefits

- Employee financial programs

- Paid time off and sick leave

- Upskilling, reskilling and certification courses

- Unlimited access to the LinkedIn Learning library and 22,000+ courses

- Global career opportunities

- Volunteer and community involvement opportunities

- EPAM Employee Groups

- Award-winning culture recognized by Glassdoor, Newsweek and LinkedIn

EPAM is an Equal Opportunity Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, national origin, age, sexual orientation, gender identity or expression, disability, protected veteran status, or any other characteristic protected by applicable law.

📌 Senior AI OPS Engineer (México)
🏢 Epam Systems
📍 México