AgileEngine is an Inc. 5000 company that creates award-winning software for Fortune 500 brands and trailblazing startups across 17+ industries. We rank among the leaders in areas like application development and AI/ML, and our people-first culture has earned us multiple Best Place to Work awards.
WHY JOIN US
If you're looking for a place to grow, make an impact, and work with people who care, we'd love to meet you
ABOUT THE ROLE
We are looking for a Lead Data Engineer to own the data pipeline and analytical architecture layer for a large-volume marketing analytics platform. You will make architectural decisions around partitioning strategy, file formats, schema design, and near-real-time processing for OLAP-oriented workloads built on an S3-backed data lake. You will design and govern ETL pipelines, define DAG-based orchestration strategies using Airflow, drive the AWS data stack including Athena and EKS, and lead a team of senior developers while enforcing code quality standards. The role requires a high degree of autonomy: you will often work on ad hoc or underspecified problems,



defining the problem, gathering context, identifying constraints, and shaping the right technical approach before implementation.
WHAT YOU WILL DO
Design and own ETL pipelines that extract, transform, and validate data from internal databases and external APIs at scale.
Make architectural calls on partitioning, file formats, schema/data-type strategy, and near-real-time processing for large-volume, OLAP-oriented data systems built on an object-storage data lake.
Own the design of scheduled batch workflows (DAGs) on the Airflow setup — defining pipeline structure, dependencies, and triggering strategy, and driving architectural conversations about them. Not responsible for administering Airflow itself.
Drive use of the AWS data stack (S3-backed data lake, Athena, EKS/Kubernetes), and partner directly with the DevOps team to clarify functional and non-functional requirements.
Review PRs and

📌 Lead Data Engineer/Data Architect (Jalisco)
🏢 Agileengine
📍 Jalisco