15 sep
|
Epam Systems
|
México
15 sep
Epam Systems
México
We are seeking a Chief Software Engineer to lead a secure, scalable AI Gateway for governed LLM and agentic workflows in multi-tenant SAAS. You will shape MCP server frameworks, routing, governance, observability, and Kubernetes delivery while partnering across product teams.
Responsibilities
- Build the AI Gateway platform across MCP, agents, LLM routing, governance, and observability
- Translate business and product requirements into crisp problem statements, architecture designs, and scalable technical solutions
- Design extensible frameworks for MCP server capabilities and integrations, along with agent orchestration and reusable agent skills
- Architect gateway features including semantic caching for LLM responses, rate limiting, quotas, traffic governance, and guardrails and validation layers for safe LLM/MCP usage
- Define and review authentication and authorization models, including multiple OIDC-based flows, identity propagation, and token-based access control for MCP and LLM traffic
- Create prototypes and reference implementations to validate architectural choices and guide engineering teams
- Collaborate with multiple product teams integrating with the AI Gateway by providing architecture guidance, best practices, and integration patterns
- Review designs and code to deliver actionable feedback that improves quality, performance, scalability, and security
- Define and review CI/CD best practices using modern GitHub-based pipelines
- Architect and review Kubernetes-based deployment models to ensure scalability, resiliency, and production readiness
Requirements
- Proven track record with 7+ years of software engineering experience, including significant responsibility in a principal engineer role
- Demonstrated experience designing and shipping large-scale distributed systems or platform products
- High proficiency in Golang and Python for production-grade services
- Hands-on familiarity with AI centric development, emphasizing quality gates and architect
📌 Chief Software Engineer (México)
🏢 Epam Systems
📍 México