16 sep
|
Epam Systems
|
México
16 sep
Epam Systems
México
We are seeking a
Chief Software Engineer
to lead a secure, scalable AI Gateway for governed LLM and agentic workflows in multi-tenant SAAS. You will shape MCP server frameworks, routing, governance, observability, and Kubernetes delivery while partnering across product teams.
Build the AI Gateway platform across MCP, agents, LLM routing, governance, and observability Translate business and product requirements into crisp problem statements, architecture designs, and scalable technical solutions Design extensible frameworks for MCP server capabilities and integrations, along with agent orchestration and reusable agent skills Architect gateway features including semantic caching for LLM responses, rate limiting, quotas, traffic governance, and guardrails and validation layers for safe LLM/MCP usage Define and review authentication and authorization models, including multiple OIDC-based flows, identity propagation, and token-based access control for MCP and LLM traffic Create prototypes and reference implementations to validate architectural choices and guide engineering teams Collaborate with multiple product teams integrating with the AI Gateway by providing architecture guidance, best practices, and integration patterns Review designs and code to deliver actionable feedback that improves quality, performance, scalability, and security Define and review CI/CD best practices using modern GitHub-based pipelines Architect and review Kubernetes-based deployment models to ensure scalability, resiliency, and production readiness Proven track record with 7+ years of software engineering experience,
including significant responsibility in a principal engineer role Demonstrated experience designing and shipping large-scale distributed systems or platform products High proficiency in Golang and Python for production-grade services Hands-on familiarity with AI centric development, emphasizing quality gates and architecture patterns that enforce agentic behavior for producing quality code Deep understanding of AI gateways, AI/LLM platforms, or middleware systems, including routing, governance, and scalability Solid background with microservices and service-oriented architectures for multi-tenant SAAS environments Practical skills using PostgreSQL for transactional data and Redis for caching and distributed coordination Strong expertise in authentication and authorization systems, especially OAuth-based approaches Proven ability to independently drive problem definition, architecture, prototype, and execution guidance Experience designing platforms and frameworks consumed by multiple product teams Experience with MCP (Model Context Protocol), agentic platforms, or AI orchestration frameworks Knowledge of working with EDA software Prior work on LLM gateways, API gateways, or AI middleware platforms Experience building generic developer frameworks or SDKs adopted across teams Familiarity with guardrails, semantic caching, prompt/response optimization, and LLM cost control techniques Experience operating high-throughput, low-latency systems in Kubernetes environments Strong written and verbal communication skills for cross-team architectural alignment
📌 Chief Software Engineer - Mcp Server (México)
🏢 Epam Systems
📍 México