job title: big data lead role

location: remote

job summary

required qualifications

- bachelor’s degree in computer science, engineering, information systems, or a related field; equivalent practical experience may be considered.
- 5+ years of experience developing and supporting data integration, elt, or data engineering solutions.
- demonstrated experience processing large data volumes in distributed or cloud-based environments.
- strong proficiency in sql and at least one programming language, such as python, java, scala, or spark sql.
- experience with orchestration and workflow tools such as apache airflow, azure data factory, or aws step functions.
- working knowledge of relational and non-relational databases, data warehouses, and data lake architectures.
- experience designing resilient data pipelines with logging, monitoring,



retry logic, idempotency, and failure recovery.
- strong analytical, troubleshooting, communication, and collaboration skills.

preferred qualifications

- experience with cloud data platforms, particularly aws.
- experience with aws services, including lambda and kafka.
- knowledge of data modeling, metadata management, data governance, and master data management practices.
- experience with containerization and deployment technologies, ci/cd pipelines, and infrastructure as code.
- experience working in regulated environments, including financial services, healthcare, or other highly controlled industries.

📌 Big data lead (México)
🏢 Pyramid Consulting
📍 México