17 ago
|
Pyramid Consulting
|
Ciudad de México
17 ago
Pyramid Consulting
Ciudad de México
Immediate need for a talented
Hadoop Developer
This is a
12+ months
opportunity with long-term potential and is located in
Mexico (onsite).
Please review the job description below and contact me ASAP if you are interested.
Job Diva ID: 26-24992
Pay Range: $50 - $60/hour. Employee benefits include, but are not limited to, health insurance (medical, dental, vision), 401(k) plan, and paid sick leave (depending on work location).
Key Responsibilities: -
- Note- Candidates must be willing to relocate and work onsite in the USA from Day 1
- Develop and maintain scalable data processing solutions using the Hadoop ecosystem, including HDFS, YARN, Hive, and HBase.
- Design and develop distributed ETL pipelines for large-volume data processing and transformation.
- Develop Spark applications using Spark SQL and Spark Streaming for batch and real-time data processing.
- Build and maintain Kafka-based data ingestion and streaming solutions.
- Use Sqoop to transfer data between relational databases and Hadoop environments.
- Develop applications and data processing scripts using Python, Scala, and/or Java.
- Create Shell scripts to automate data processing and operational tasks.
- Develop and manage Airflow workflows for data pipeline orchestration and scheduling.
- Optimize distributed processing jobs for performance, scalability, and reliability.
- Troubleshoot data pipelines, Spark jobs, Hadoop components, and production data-processing issues.
- Collaborate with data engineers and technical teams to support data integration and large-scale analytics requirements.
Key Requirements and Technology Experience:
- Must have skills: - Hadoop Ecosystem (HDFS, YARN, Hive, HBase), Spark (SQL, Streaming), Kafka, Sqoop, Python/Scala/Java, Shell scripting, Airflow (workflow orchestration), distributed data processing, ETL pipelines
Our client is a leading
IT Industry,
and we are currently interviewing to fill this and other similar contract positions. If you are interested in this p
📌 Hadoop Developer (Ciudad de México)
🏢 Pyramid Consulting
📍 Ciudad de México