31 oct
|
Ensitech
|
México
Join #Ensiteam!
We are a company focused on custom software development and have been in the market for over 22 years. At Ensitech, we are dedicated to finding highly specialized talent to work with large companies in the United States, Europe, and Canada.
Each one of our collaborators works with different teams and colleagues around the world, in the design and commercialization of software. We look forward to having you as part of our team in the role of Data Engineer / Data Integration & Pipelines, building reliable, high-performance pipelines that bring together data from different enterprise systems. The focus of this role is data pipelines, not AI or machine learning.
Key Responsibilities
- Design and build data pipelines that integrate sources of different types, especially enterprise systems such as ERPs, CRMs, and HR platforms.
- Load, transform, and model data in Snowflake, Databricks and S3.
- Implement strict non-functional requirements, such as latency targets, request limits on source systems to avoid throttling or blocking, retry logic, and consistency checks.
- Build resumable processes for data transmissions and downloads so that failures do not require starting over.
- Design resumption and retry mechanisms that are also idempotent.
- Orchestrate and monitor workflows, preferably on AWS using Step Functions.
- Write clean,
maintainable Python and SQL for ingestion, transformation, and automation.
- Document pipelines and collaborate with the team on standards and best practices.
- Use AI coding assistants to speed up development, while reviewing, auditing, and correcting all AI-generated code before it reaches production.
Required Skills & Experience
- 5+ years of experience in data engineering.
- Proven experience integrating data from multiple source types, especially ERP, CRM, and HR systems.
- Hands-on experience with Snowflake or Databricks, and with S3.
- Strong Python and SQL.
- Experience in projects with demanding non-functional requirements, such as latency limits, source rate limits, retries, consistency checks, and resumable transfers.
- Experience designing idempotent retry and resumption mechanisms.
- Judgment and discipline to validate AI-generated code, including checking its logic, security, performance, and test coverage, and taking full ownership of what is delivered.
- Professional English.
Nice to Have
- Experience implementing and monitoring resilient pipelines on AWS with Step Functions.
- Experience with DuckDB.
What do we offer?
✅ Competitive salary and benefits.
✅ International and innovation-driven environment.
📌 Sr Data Engineer (México)
🏢 Ensitech
📍 México