31 jul
|
Agileengine
|
México
31 jul
Agileengine
México
About the Role
We are looking for a Data Engineer to support a strategic data platform migration, moving tables, views, and stored procedures from Amazon Redshift to Databricks. You will build and support Databricks pipelines and jobs, work with AWS services including S3, Glue, and Athena, and apply data governance practices including data lineage, cataloging, and role-based access controls throughout the migration. The role requires 3–5 years of data engineering experience.
This is a 5–6 month project engagement.
What you will do Migrate tables, views, and stored procedures from Amazon Redshift to Databricks.
Build and support Databricks pipelines and jobs.
Work with AWS services, including Amazon S3, AWS Glue, and Amazon Athena.
Support data migration activities within a modern data lake architecture.
Apply data governance and data management practices throughout the migration.
Collaborate with project stakeholders to support migration activities. Must haves
3–5 years of experience as a Data Engineer.
Hands-on experience with Databricks.
Experience with Amazon Redshift.
Strong SQL skills.
Experience with AWS services, including Amazon S3, AWS Glue,
and Amazon Athena.
Experience building and supporting Databricks pipelines and jobs.
Understanding of data lake architectures.
Familiarity with data governance and data management practices, including data lineage, data catalogs, and role-based access controls (RBAC). Nice to haves
Experience with Databricks Lakebridge transpiling capabilities. Perks and Benefits
Professional growth
Accelerate your professional journey with mentorship, TechTalks, and personalized growth roadmaps
Competitive compensation
We match your ever-growing skills, talent, and contributions with competitive USD-based compensation and budgets for education, fitness, and team activities A selection of exciting projects
Join projects with modern solutions development and top-tier clients that include Fortune 500 enterprises and leading product brands
Flextime
Tailor your schedule for an optimal work-life balance, by having the options of working from home and going to the office – whatever makes you the happiest and most productive.
📌 Data Engineer (México)
🏢 Agileengine
📍 México