We are seeking a Senior Data Engineer with proven expertise in Azure Data Platform technologies, Databricks, and PySpark to strengthen our growing data engineering organization. In this position, you will craft and deliver scalable, cloud-native data solutions that drive enterprise analytics, reporting, and business intelligence efforts. You will manage large-scale datasets, develop reusable ingestion frameworks, refine data pipelines, and play a key role in evolving modern data platforms built on Azure and Databricks. The right candidate pairs strong hands-on engineering capabilities with a background in designing robust, metadata-driven data solutions, along with a genuine drive to deliver high-quality, maintainable data products.
ResponsibilitiesDesign, build, and sustain scalable data ingestion, transformation, and delivery pipelinesDeliver cloud-native data solutions using Azure and Databricks technologiesCreate and refine ETL/ELT processes with PySpark, Spark SQL,



and Delta LakeApply metadata-driven and configuration-based ingestion frameworks to boost scalability and maintainabilityBuild and sustain batch and incremental data processing pipelinesSet up data quality controls, validation frameworks, monitoring, logging, and error handling mechanismsWork closely with business stakeholders, architects, and engineering teams to capture requirements and deliver data solutionsAddress production issues and push forward continuous improvements in platform reliability and performanceTrack and fine-tune Databricks workloads for efficiency, scalability, and cost managementUphold engineering best practices including code reviews, automated testing, CI/CD, and infrastructure automationContribute to data governance, security, and access management initiatives using Unity Catalog and Azure servicesGuide team members and shape engineering standards and best practicesRequirements3+ years of experience in Data Engineering or Software EngineeringExpertise in Azure Databricks, Ap

📌 Senior Data Engineer (Ciudad de México)
🏢 Epam Systems
📍 Ciudad de México