06 ago
|
KMS Technology
|
Guadalajara
06 ago
KMS Technology
Guadalajara
Job Description
We are seeking a highly skilled Senior Data Engineer with strong experience in Databricks and Microsoft Azure to design, develop, and maintain scalable data solutions that support business intelligence, analytics, and operational workloads. This role is responsible for building robust data pipelines, optimizing data processing, and ensuring reliable, high-performance data platforms.
You will collaborate with clients, business stakeholders, and cross-functional engineering teams to translate business requirements into scalable technical solutions. This position also involves partnering with distributed teams globally, requiring strong communication and collaboration skills to deliver high-quality data solutions.
Responsibilities
- Design, develop, and maintain scalable data pipelines using Databricks and Azure services.
- Build and optimize ETL/ELT workflows to support data ingestion, transformation, and delivery.
- Develop and optimize Apache Spark (PySpark) jobs to efficiently process large-scale datasets.
- Design and implement scalable data solutions that support analytics, reporting, and operational business needs.
- Collaborate with business stakeholders and clients to gather requirements and translate them into technical solutions.
- Ensure data quality, consistency, reliability, and performance across all data processing workflows.
- Optimize data processing jobs and storage solutions to improve performance and resource utilization.
- Troubleshoot and resolve issues related to data pipelines, Spark jobs, and Azure data services.
- Participate in architecture discussions, code reviews, and technical design sessions.
- Create and maintain technical documentation for data pipelines, data models, and operational processes.
- Work closely with distributed teams globally to coordinate delivery efforts and support effective cross-team collaboration.
📌 Senior Data Engineer (Guadalajara)
🏢 KMS Technology
📍 Guadalajara