19 ago
|
SpaceDev
|
Ciudad de México
19 ago
SpaceDev
Ciudad de México
**Data Engineer**
Join SpaceDev and be part of a cutting-edge team driving innovation in data engineering! We are looking for a **Senior Data Engineer** to design and build scalable data solutions that power AI-driven insights. If you are passionate about cloud-based data architectures and thrive in a collaborative environment, this is your opportunity to make a real impact.
**Key Responsibilities**
- Design, develop, and maintain highly scalable data engineering solutions using AWS services.
- Build and optimize ETL/ELT pipelines, ensuring data quality and reliability.
- Ingest and transform structured, semi-structured, and unstructured data from multiple sources.
- Develop proprietary algorithms to tackle complex data challenges.
- Implement and optimize customer data ingestion and model deployment processes.
- Collaborate with data scientists, engineers, and product teams to develop AI-driven solutions.
- Leverage cloud provider AI services and best practices for ML workflows.
- Monitor workflow performance, reliability, and meet SLA targets.
- Automate processes using scripting, CI/CD, and infrastructure-as-code tools.
- Troubleshoot and solve complex data engineering challenges.
**Skills, Knowledge, and Expertise**
- 5+ years of experience with **Python** and **Scala** for data engineering and ETL.
- 5+ years of experience with **data pipeline tools** (e.g., Informatica, Spark, Spark SQL), DAG orchestration, and workflow management tools (e.g., Airflow, AWS Step Functions).
- 5+ years of experience working with **AWS** or **GCP** cloud ecosystems.
- 3+ years of experience using **Cloud AI services**.
- 3+ years of hands-on experience developing **ETL solutions** with AWS services (S3, IAM, Lambda, RDS, Redshift, Glue, SQS, EKS, ECR).
- Strong expertise in **SQL programming** and writing complex queries.
- Experience with **distributed computing tools** (e.g., Spark, Hive).
- Proficiency in **software engineering best practices**, including version control (Git), CI/CD (Jenkins, GitLab CI/CD, GitHub Actions), and DevOps.
- Experience with **containers and orchestration** (Docker, Kubernetes, Helm).
- Ability to work in a **fast-paced agile environment**.
**Nice to Have**
- AWS certifications (AWS Certified Solutions Architect, Developer, or DevOps).
- Knowledge of **commercial claims management systems**.
**Space Perks**
- 20 vacation days + 3 extra days off per year to recharge
- Access to Udemy courses and the ability to propose new learning tracks
- English classes for all levels
- Work-life balance with our adaptable work culture
- Special days off for birthdays and significant occasions
- Team trips: Participate in tech events and team-building experiences
- Performance and inflation adjustments (1-2 times a year)
- Remote-first with offices in Montevideo, Medellín, Buenos Aires, and coworking options globally.
Pay: $50,000.00 - $75,000.00 per month
**Language**:
- English (required)
Work Location: In person
📌 Data Engineer (Ciudad de México)
🏢 SpaceDev
📍 Ciudad de México