We are building cloud-scale data pipelines and platforms as a Lead Data Software Engineer to enable analytics, reporting, and AI-driven initiatives. You will collaborate with Product, Engineering, and Business teams to deliver reliable solutions using Azure Databricks, Spark, Kafka, and modern governance practices. Responsibilities Design scalable batch and streaming data pipelines Build and fine-tune Databricks, Spark, and Kafka-based solutions Implement data quality, governance, and observability standards Develop data models and reporting foundations for analytics and AI initiatives Collaborate with Product, Engineering, and Business teams to deliver data-driven solutions Support enterprise reporting, dashboards, and self-service analytics platforms Leverage AI tools such as Claude Code, Git Hub Copilot, and similar platforms for development, testing, and productivity improvements Apply MCP, prompt engineering, and multiple LLMs in AI-assisted development workflows Requirements Proven track record with 5+ years of experience in data engineering or a related field Hands-on proficiency in SQL, Python, Py Spark, Scala, and Java Deep expertise in Apache Spark, Spark SQL, Kafka, and Delta Lake Strong experience with Azure Databricks, Unity Catalog, and Databricks Asset Bundles (DAB)Solid familiarity with Azure Data Factory (ADF), ADLS Gen2, Azure Key Vault, Azure Cosmos DB, and Azure Monitor Thorough knowledge of Data Modeling,



Data Quality, Data Governance, and PII Handling Demonstrated background in Medallion Architecture (Bronze/Silver/Gold), CDC, and SCD Type 1 & Type 2 Practical competency in Azure Dev Ops, Git, CI/CD, and Gradle English proficiency at B2+ (Upper-Intermediate) level Nice to have Familiarity with Tableau, Thought Spot, Cognos, and Data Visualization Best Practices Knowledge of Semantic Layer Concepts, AI/BI Dashboards, and Databricks Genie Understanding of scalable data platforms, analytics, and reporting solutions We offer International projects with top brands Work with integral teams of highly skilled, diverse peers Healthcare benefits Employee financial programs Paid time off and sick leave Upskilling, reskilling and certification courses Unlimited access to the Linked In Learning library and 22,000+ courses Global career opportunities Volunteer and community involvement opportunities EPAM Employee Groups Award-winning culture recognized by Glassdoor, Newsweek and Linked In EPAM is an Equal Opportunity Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, national origin, age, sexual orientation, gender identity or expression, disability, protected veteran status, or any other characteristic protected by applicable law.
#J-18808-Ljbffr

📌 Lead data software engineer (Ciudad de México)
🏢 Epam Systems
📍 Ciudad de México