Required Experience & Qualifications

- Bachelor's degree in Computer Science, Engineering, Information Technology, or equivalent practical experience.

- 6+ years of experience in Data Engineering, Big Data Engineering, or related disciplines.

- Strong experience with
Python for data engineering and pipeline development.

- Hands-on experience with

Apache Airflow for workflow orchestration (

required

).

- Advanced experience with

PySpark

,

Spark SQL

, and distributed data processing.

- Experience with
Scala in data engineering environments.

- Strong knowledge of relational and NoSQL database technologies.

- Experience writing and optimizing complex SQL queries.

- Hands-on experience with

Apache Kafka and event-driven architectures.





- Experience building and supporting real-time data pipelines using

Spark Streaming

.

- Strong experience with

Google Cloud Platform (GCP)

, specifically:

- BigQuery

- Dataproc
- Experience integrating RESTful APIs into data pipelines and data workflows.

- Experience implementing CI/CD practices using

GitLab CI

.

- Strong understanding of data modeling, data quality, scalability, and performance optimization.

- Excellent verbal communication and technical problem-solving skills.

- Ability to explain design decisions and implementation approaches in a collaborative setting.

📌 Senior Big Data Engineer (GCP / Python / PySpark /Streaming) (México)
🏢 Apex Systems
📍 México