11 nov
|
Apex Systems
|
México
11 nov
Apex Systems
México
- Bachelor's degree in Computer Science, Engineering, Information Technology, or equivalent practical experience.
- 6+ years of experience in Data Engineering, Big Data Engineering, or related disciplines.
- Strong experience with Python for data engineering and pipeline development.
- Hands-on experience with Apache Airflow for workflow orchestration (required ).
- Advanced experience with Py Spark , Spark SQL , and distributed data processing.
- Experience with Scala in data engineering environments.
- Strong knowledge of relational and No SQL database technologies.
- Experience writing and optimizing complex SQL queries.
- Hands-on experience with Apache Kafka and event-driven architectures.
- Experience building and supporting real-time data pipelines using Spark Streaming .
- Strong experience with Google Cloud Platform (GCP) , specifically:
- Big Query
- Experience integrating RESTful APIs into data pipelines and data workflows.
- Experience implementing CI/CD practices using Git Lab CI .
- Strong understanding of data modeling, data quality, scalability, and performance optimization.
- Excellent verbal communication and technical problem-solving skills.
- Ability to explain design decisions and implementation approaches in a collaborative setting.
#J-18808-Ljbffr
📌 Senior Big Data Engineer (gcp / Python / Pyspark /streaming) (México)
🏢 Apex Systems
📍 México