13 oct
|
Avacone
|
San Antonio Tecómitl
13 oct
Avacone
San Antonio Tecómitl
Description The Opportunity We are supporting a major data platform transformation within a banking environment, moving from a legacy SQL Server and SSIS-based setup to a modern, scalable architecture built on dbt, Dagster, and OpenShift. This role is not about maintaining existing systems. It is about rebuilding a critical data platform from the ground up, with direct impact on risk, trading PnL, and core financial data flows.
We are looking for a hands-on Senior Data Engineer who can take ownership of complex migration workstreams and deliver reliably in a regulated, high-stakes environment.
What You Will Do You will play a central role in the end-to-end migration and modernisation of the data platform.
Platform
Transformation - Translate legacy ETL logic from SSIS and stored procedures into modern ELT pipelines using dbt
- Implement Data Vault 2.0 structures including Raw Vault and Business Vault
- Build datamarts and curated datasets for downstream analytics and reporting Orchestration & Infrastructure - Design and operate workflows using Dagster, including scheduling, dependencies, and recovery mechanisms
- Deploy and run data workloads on OpenShift / Kubernetes environments Event-Driven Data Processing - Enable near real-time data processing using Kafka-triggered pipelines
- Integrate with upstream data lake environments and external data providers Data Quality & Validation - Establish robust data validation and reconciliation processes
- Implement automated testing and monitoring using dbt Operational Ownership - Support production pipelines and resolve incidents when required
- Create clear documentation and ensure operational readiness
- Continuously improve performance, reliability, and maintainability What You Will Do You will play a central role in the end-to-end migration and modernisation of the data platform.
Platform
Transformation - Translate legacy ETL logic from SSIS and stored procedures into modern ELT pipelines using dbt
- Implement Data Vault 2.0 structures including Raw Vault and Business Vault
- Build datamarts and curated datasets for downstream analytics and reporting Orchestration & Infrastructure - Design and operate workflows using Dagster, including scheduling, dependencies, and recovery mechanisms
- Deploy and run data workloads on OpenShift / Kubernetes environments Event-Driven Data Processing - Enable near real-time data processing using Kafka-triggered pipelines
- Integrate with upstream data lake environments and external data providers Data Quality & Validation - Establish robust data validation and reconciliation processes
- Implement automated testing and monitoring using dbt Operational Ownership - Support production pipelines and resolve incidents when required
- Create clear documentation and ensure operational readiness
- Continuously improve performance, reliability, and maintainability Requirements
What You Bring Technical Expertise - Strong experience with SQL Server and T-SQL, including performance optimisation
- Proven hands-on experience with dbt in production environments
- Solid experience with workflow orchestration tools, ideally Dagster
- Practical knowledge of Data Vault 2.0 modelling concepts
- Experience working with container platforms such as OpenShift or Kubernetes
- Familiarity with event-driven architectures and Kafka Domain Experience - Experience working with financial data, ideally in banking or trading environments
- Understanding of risk and PnL data structures is a strong advantage Working Style - Strong ownership mindset with the ability to work independently
- Structured, pragmatic, and delivery-focused
- Comfortable operating in complex and regulated environments
- Clear communicator across both technical and business stakeholders What Success Looks Like Within the first months, you will have:
- Delivered initial Data Vault structures and migrated datasets into the new platform
- Established stable, event-driven pipelines
- Ensured data consistency and validation between legacy and new systems
- Contributed to a production-ready, scalable data platform
📌 Senior Data Engineer (San Antonio Tecómitl)
🏢 Avacone
📍 San Antonio Tecómitl