We are seeking a skilled Senior Data Engineer to design, build, and deliver data engineering solutions on our Databricks-based healthcare data platform. This is a hands-on individual contributor role, executing within established engineering standards to build and maintain production-grade data pipelines, contribute to our migration from SQL Server to Databricks, and uphold platform quality and reliability. The Senior Data Engineer works closely with the Principal Data Engineer and broader team to deliver data engineering workstreams across ingestion, transformation, and serving layers.
- Design, build, and maintain production-grade data pipelines using PySpark and Spark Declarative Pipelines (Delta Live Tables) on Databricks.
- Develop modular, tested, and documented dbt transformation models as part of the team's analytics engineering layer.
- Implement and maintain multi-layer data architectures (Bronze/Silver/Gold) on Delta Lake following medallion architecture principles.
- Contribute to the migration of data pipelines, stored procedures,



and SSIS packages from SQL Server to Databricks, ensuring logic fidelity and data integrity.
- Ensure pipeline reliability through robust error handling, data quality checks, and SLA-aligned alerting.
- Manage Databricks compute resources, cluster configurations, and job scheduling via Databricks Workflows.
- Enforce data security and access controls within pipeline and storage design via Unity Catalog.
- Participate in code reviews, contribute to engineering discussions, and help uphold team-wide coding standards.
- Write clean, maintainable Python and SQL code following version control and CI/CD best practices.
- 5+ years of experience in data engineering with a strong focus on pipeline development.
- Hands-on expertise with Databricks, including Delta Lake, Databricks Workflows, and Unity Catalog.
- Proficiency in PySpark and Apache Spark for large-scale distributed data processing.
- Experience building pipelines with Spar

📌 Senior Data Engineer (México)
🏢 Improving South America
📍 México