Big Data Lead
Location: Remote – Mexico
Employment type: Full-time
Salary: $85,000 MXN gross per month
Benefits: Benefits above Mexican statutory requirements
About the Role
We are looking for an experienced Big Data Lead to design, develop, and support scalable data integration, ELT, and data engineering solutions.
The successful candidate will work with large data volumes in distributed and cloud-based environments, creating resilient pipelines with effective monitoring, logging, retry mechanisms, idempotency, and failure recovery.
Key Responsibilities
- Lead the design and development of scalable data integration and ELT solutions.
- Develop and support data pipelines in distributed and cloud-based environments.
- Process and optimize large volumes of structured and unstructured data.
- Design reliable pipelines with logging, monitoring, retry logic, idempotency, and recovery mechanisms.
- Work with relational and nonrelational databases, data warehouses, and data lakes.
- Develop complex SQL queries and data transformations.
- Implement workflow orchestration using tools such as Apache Airflow, Azure Data Factory, or AWS Step Functions.
- Integrate batch, streaming, API, and cloud-based data sources.
- Troubleshoot data quality, performance, and production pipeline issues.
- Collaborate with engineering, architecture, business, and governance teams.
- Support code reviews, technical documentation, and engineering standards.
- Contribute to data modeling, metadata management, governance, and master data management practices.
Required Qualifications
- Bachelor’s degree in Computer Science, Engineering, Information Systems, or a related field; equivalent practical experience may be considered.
- 5+ years of experience developing and supporting data integration, ELT, or data engineering solutions.
- Demonstrated experience processing large data volumes.
- Strong SQL proficiency.
- Strong experience with at least one of the following: Python, Java, Scala, Spark
📌 Big Data Lead (México)
🏢 U-Hi
📍 México