19 oct
|
Epam Systems
|
México
19 oct
Epam Systems
México
We are looking for a Senior Data Engineer to build and evolve a next-generation analytics platform with a strong focus on Databricks-based data products. You will combine hands-on delivery, technical leadership, and architecture to enable trusted, scalable, and AI-enabled data capabilities. Responsibilities Design scalable data ingestion and transformation frameworks for analytics use cases Build batch, near real-time, and streaming pipelines using Databricks and Apache Spark Define Databricks best practices for Medallion layers, performance, and operations Deliver end-to-end data products from raw ingestion through governed consumption layers Develop trusted analytical datasets and semantic models for reporting and self-service Implement data quality, lineage, monitoring,
and observability across pipelines Lead proof-of-concepts and evaluate new capabilities within the Databricks ecosystem Enable AI-assisted engineering patterns and reusable accelerators for faster delivery Coordinate with engineering and analytics stakeholders to align on delivery plans Mentor engineers and promote consistent platform standards across teams Requirements3+ years of data engineering experience with modern data platforms Strong leadership skills to drive engineering standards and mentor other engineers Proven project delivery experience building enterprise analytics solutions end to end Advanced Apache Spark and Py Spark skills for large-scale processing Advanced Databricks skills in production environments, including performance tuning Strong SQL skills for transformation logic and analytics-ready datasets Solid data architecture knowledge, including Lakehouse and Medallion patterns Hands-on CI/CD and data engineering SDLC experience using Git-based workflows Strong data governance skills covering security, quality, and operational controls Excellent communication skills to lead technical discussions with cross-functional teams Upper-Intermediate English proficiency (B2) for effecti
📌 Senior data engineer (México)
🏢 Epam Systems
📍 México