12 sep
|
DataArt
|
Monterrey
If you received this vacancy from our recruiters — read our Privacy Notice .
Technology stack
Java, Python, SQL (Oracle and PostgreSQL), AWS (Glue, Athena, Redshift), dbt, Maven, Git
Project overview
The program is a multi phase data migration initiative replacing legacy capital markets systems with a modern platform ecosystem. It includes critical datasets across custody, clearing and settlement, derivatives processing, and CCP operations. The project spans 18 months and follows an incremental approach, with a strong emphasis on data integrity, reconciliation, and traceability.
Position overview
We are looking for a Senior Data Engineer to develop and optimize data pipelines within a large scale data migration program in a capital markets environment. This is a hands on, developer oriented role for someone with a strong software engineering background who has moved into Data Engineering and cloud data migration on AWS.
You will design and implement robust, scalable, production grade data pipelines, ensuring data quality, consistency, reconciliation,
and traceability across multiple systems.
Responsibilities
- Design and implement scalable ETL/ELT pipelines using AWS Glue, Python, and dbt.
- Take a highly hands on role, spending most of your time coding and reviewing code.
- Integrate data from multiple Oracle and PostgreSQL legacy systems into AWS.
- Write and optimize complex SQL and Java/Python data transformation logic.
- Define and enforce coding standards, testing practices, code reviews, CI/CD processes, and deployment procedures.
- Guide and mentor mid level engineers through technical direction and code reviews.
- Ensure data quality, consistency, integrity, reconciliation, and traceability.
- Collaborate with data architects on target data models and transformation strategies.
- Optimize pipelines for performance, scalability, and cost efficiency across AWS Glue, Athena, and Redshift.
- Implement error handling, logging, monitoring, and observabilit
📌 Senior Data Engineer (Monterrey)
🏢 DataArt
📍 Monterrey