31 jul
|
Code17Tek
|
México
Job Title: Lead Azure Data Engineer
:
We are seeking an experienced Lead Azure Data Engineer with a strong background in cloud data engineering and a proven track record of delivering scalable data solutions. The ideal candidate will have hands-on expertise in Azure Data Platform tools such as PySpark, Databricks, and Azure Data Factory (ADF), and possess a keen understanding of modern data architecture and engineering practices.
Experience with additional platforms like AWS, Snowflake, GCP, and BigQuery is preferred and highly valued.
This role will require strong technical leadership, collaboration with cross-functional teams, and a focus on building robust, enterprise-grade data pipelines and solutions.
Key Responsibilities
- Design and Develop Data Solutions: Lead the design, development, and optimization of scalable and high-performance data pipelines using Azure Databricks, ADF, and PySpark.
- Cloud Integration: Implement modern data architecture solutions, including seamless integration with Azure Data Lake, Azure Synapse, and other Azure services.
- Data Modeling: Develop and maintain efficient data models that support enterprise reporting, analytics, and machine learning.
- Performance Optimization: Optimize data pipelines for speed, reliability, and efficiency, including troubleshooting and fine-tuning existing systems.
- Cross-Platform Expertise: Leverage experience with AWS (Redshift, Glue), Snowflake, GCP (BigQuery), or similar platforms to design and implement hybrid or multi-cloud data strategies.
- Collaboration: Work closely with stakeholders, including data scientists, analysts, and business teams,
to understand requirements and deliver solutions that meet business goals.
- Data Governance: Ensure data quality, security, and governance policies are adhered to throughout the engineering lifecycle.
- Team Leadership: Provide technical leadership and mentorship to junior engineers, fostering a culture of collaboration and innovation.
Qualifications and Skills
Required
- Bachelor’s or Master’s degree in Computer Science, Engineering, or a related field.
- 8+ years of experience in data engineering, with at least 3 years in a leadership role.
- Hands-on experience with Azure Data Platform, including:
- Databricks (advanced experience in building and optimizing data pipelines).
- Azure Data Factory (ADF).
- PySpark (proficient in writing and optimizing Spark jobs).
- Strong experience with SQL and designing ETL pipelines.
- Solid understanding of data lake architectures and best practices.
Preferred:
- Experience with AWS (Redshift, Glue) and Snowflake for cloud data warehousing.
- Proficiency in Google Cloud Platform (GCP) and tools like BigQuery.
- Knowledge of DevOps practices for data engineering, including CI/CD pipelines, Infrastructure-as-Code, and monitoring.
- Familiarity with data governance tools like Informatica,
Azure Purview, or similar.
- Exposure to machine learning pipelines and integration with data engineering workflows.
Soft Skills: Strong leadership, communication, and problem-solving skills.
Ability to manage competing priorities in a fast-paced environment.
Passion for learning and staying current with the latest technologies and trends in data engineering.
About Code17:
Code17, headquartered in Dallas, TX, USA, is a fast-growing data engineering and advanced analytics firm dedicated to delivering AI-driven and data-focused solutions to our clients. With an engineering presence and operations spanning the USA, Latin America, India, Taiwan, and Europe, we bring a truly integral perspective to every engagement.
We empower companies to drive digital transformation by integrating digital and traditional data, giving them a competitive edge. Code17 provides a comprehensive 360-degree view of the digital consumer, enabling businesses to predict new revenue streams, anticipate product trends, improve customer retention, and optimize investment decisions.
Our expertise spans predictive modeling, marketing analytics, big data analytics, advanced analytics, web analytics, data science, data engineering, artificial intelligence, and machine learning applications.
At Code17, we encourage our employees to think big, embracing innovation beyond conventional ideas and perspectives.
Our long-term vision is to inspire and transform businesses to thrive in the digital era by harnessing the full potential of data and analytics.
📌 Lead Azure Data Engineer (México)
🏢 Code17Tek
📍 México