03 oct
|
Epam Systems
|
México
03 oct
Epam Systems
México
We are seeking a Lead Software Engineer to drive the design and growth of an AI Gateway that delivers secure, scalable LLM access in SAAS. You will shape MCP server and agent workflows, set governance and observability standards, and guide teams on architecture patterns and quality the AI Gateway platform across MCP, agents, LLM routing, governance, and observabilityTranslate business and product needs into crisp problem statements, architectural designs, and scalable technical solutionsDesign extensible frameworks for MCP server capabilities and integrations, plus agent orchestration and reusable agent skillsArchitect gateway features such as semantic caching for LLM responses, rate limiting, quotas, traffic governance, and guardrails and validation layers for safe LLM/MCP usageDefine and review authentication and authorization models, including multiple OIDC-based flows, identity propagation,
and token-based access control for MCP and LLM trafficBuild prototypes and reference implementations to validate architectural decisions and guide engineering teamsCollaborate with multiple product teams integrating with the AI Gateway by providing architecture guidance, best practices, and integration patternsReview designs and code, providing actionable feedback to improve quality, performance, scalability, and securityDefine and review CI/CD best practices using modern GitHub-based pipelinesArchitect and review Kubernetes-based deployment models to ensure scalability, resiliency, and production readinessRequirements5+ years of software engineering experience, including major ownership in a principal engineer roleHands-on experience designing and shipping large-scale distributed systems or platform productsStrong programming skills in Golang and PythonSolid background in AI centric development with a strong focus on quality gates and architecture patterns that enforce agentic behavior for producing quality codeDeep understanding of AI gateways, AI/LLM platforms, or middlewa
📌 Lead Software Engineer (México)
🏢 Epam Systems
📍 México