- Bachelor's degree in Computer Science, Engineering, Information Technology, or equivalent practical experience.
- 6 years of experience in Data Engineering, Big Data Engineering, or related disciplines.
- Strong experience with Python for data engineering and pipeline development.
- Hands-on experience with Apache Airflow for workflow orchestration (required).
- Advanced experience with PySpark, Spark SQL, and distributed data processing.
- Experience with Scala in data engineering environments.
- Strong knowledge of relational and NoSQL database technologies.
- Experience writing and optimizing complex SQL queries.
- Hands-on experience with Apache Kafka and event-driven architectures.
- Experience building and supporting real-time data pipelines using Spark Streaming.
- Strong experience with Google Cloud Platform (GCP), specifically:
- BigQuery
- Dataproc
- Experience integrating RESTful APIs into data pipelines and data workflows.
- Experience implementing CI/CD practices using GitLab CI.
- Strong understanding of data modeling, data quality, scalability, and performance optimization.
- Excellent verbal communication and technical problem-solving skills.
- Ability to explain design decisions and implementation approaches in a collaborative setting.
📌 Senior Big Data Engineer (GCP / Python / PySpark /Streaming) (México)
🏢 Apex Systems
📍 México
Postulate a este anuncio
Muestra tus habilidades a la empresa, rellenar el formulario y deja un toque personal en la carta, ayudará el reclutador en la elección del candidato.