required qualifications & experience

- bachelor's degree in computer science, information technology, engineering, or a related discipline, with 6-10 years of experience in data engineering, application development, system integration, or enterprise data warehouse projects.
- strong hands-on experience designing and implementing modern data platforms on azure databricks, leveraging delta lake, delta live tables (dlt), and medallion architecture (bronze, silver, gold) to build scalable and reliable data pipelines.
- proven expertise in developing and optimizing batch and streaming data pipelines using pyspark, spark sql, and python, with a strong focus on performance tuning, scalability, and cost optimization.
- extensive experience in databricks job performance optimization, including query tuning, partitioning strategies, data skew mitigation, caching, cluster sizing, workload optimization, and spark execution plan analysis.
- strong proficiency in sql programming and data modeling concepts, including relational, dimensional, and lakehouse data architectures.
- deep understanding of delta lake features such as acid transactions, schema evolution, time travel, change data capture (cdc),



and data quality enforcement.
- experience implementing data quality, monitoring, and orchestration frameworks using delta live tables expectations, databricks workflows, and azure-native services.
- strong exposure to the full software development life cycle (sdlc), including design, development, testing, ci/cd, deployment, and production support.
- solid understanding of lakehouse architecture, cloud-based analytics platforms, data governance, and data engineering best practices.
- knowledge of real-time data processing, data integration patterns, and enterprise-scale data migration initiatives is a strong advantage.
- demonstrated ability to stay current with evolving cloud and big data technologies and contribute effectively to architecture discussions, technology strategy, and platform modernization initiatives.
- self-motivated, proactive, and capable of working independently in a fast-paced environment while collaborating with globally distributed teams.
- strong analytical, problem-solving, communication, and stakeholder management skills.

📌 Senior databricks engineer (México)
🏢 Entellux
📍 México