15 sep
|
Agileengine
|
Jalisco
15 sep
Agileengine
Jalisco
agileengine is an inc. 5000 company that creates award-winning software for fortune 500 brands and trailblazing startups across 17+ industries. We rank among the leaders in areas like application development and ai/ml, and our people-first culture has earned us multiple best place to work awards.
why join us
if you're looking for a place to grow, make an impact, and work with people who care, we'd love to meet you!
about the role
we are looking for a senior data engineer to lead the replacement of a third-party digital ingestion tool with a custom-built etl pipeline. This person will document existing logic, evaluate build-vs-buy options such as fivetran, and build a standalone pipeline within an existing aws environment. Strong sql and dsp or programmatic advertising experience are central to this role.
what you will do
- document current ingestion logic inside the legacy tool (tapclicks), including sources, endpoints, schemas, and transformation logic.
- build the etl pipeline to replace the legacy system, handling ingestion from the amazon api, other dsp platforms, and related digital data sources.
- evaluate and decide between off-the-shelf solutions (e.g., fivetran) and custom-built etl systems alongside the infrastructure lead.
- design the pipeline as a standalone, owned system to power client-facing dashboards.
- provide adaptable engineering support for application and backend work within the aws environment when directed.
- coordinate with data science teams to ensure ingestion output aligns with the attribution and scoring logic of downstream models.
- work seamlessly within the existing aws environment (ecs, s3, rds) rather than standing up parallel infrastructure.
must haves
- 4+ years of strong sql and large-scale data ingestion/pipeline experience (batch etl, orchestration, schema design).
- direct or adjacent experience with digital advertising / dsp data (e.g., amazon dsp, amazon advertising api, or comparable programmatic platforms).
- working knowledge of aws data services (rds/postgres, s3, ecs) sufficient to build within an existing cloud environment.
- ability to contribute to application and backend work beyond pure etl to support broader platform needs.
- familiarity with, or ability to quickly evaluate, managed elt tools (such as fivetran ) against custom builds.
- ability to ramp into existing attribution and scoring logic so ingestion output aligns with downstream dashboard needs.
- upper-intermediate english level.
nice to haves
- experience replacing legacy third-party data pipelines with owned, custom infrastructure.
- familiarity with mlops pipelines and how data feeds predictive models.
- experience working alongside part-time technical advisory leads to validate architecture decisions.
perks and benefits
- professional growth : accelerate your professional journey with mentorship, techtalks, and personalized growth roadmaps.
- competitive compensation : we match your ever-growing skills, talent, and contributions with competitive usd-based compensation and budgets for education, fitness, and team activities.
- a selection of exciting projects : join projects with modern solutions development and top-tier clients that include fortune 500 enterprises and leading product brands.
- flextime : tailor your schedule for an optimal work-life balance, by having the options of working from home and going to the office – whatever makes you the happiest and most productive.
#j-18808-ljbffr
📌 Senior data engineer id88015 (Jalisco)
🏢 Agileengine
📍 Jalisco