27 ago
|
Agileengine
|
México
27 ago
Agileengine
México
AgileEngine is an Inc. 5000 company that creates award-winning software for Fortune 500 brands and trailblazing startups across 17+ industries. We rank among the leaders in areas like application development and AI/ML, and our people-first culture has earned us multiple Best Place to Work awards.
WHY JOIN US
If you're looking for a place to grow, make an impact, and work with people who care, we'd love to meet you
ABOUT THE ROLE
We are looking for a Senior Data Engineer to own ingestion, pipeline orchestration, and the Single Source of Truth architecture for new product modules. You will build containerized data pipelines on AWS, integrate directly with AI APIs, and manage the data lifecycle from extraction through user acceptance testing. This role requires strong autonomy, since it operates without dedicated QA support during the initial build phase.
WHAT YOU WILL DO
- Construct the core ingestion pipelines to pull high-volume metrics from the YouTube Data API, YouTube Creator API, Google Trends, and Later Social into the AWS S3/Glue/Athena SSoT.
- Write and maintain containerized Python workers (RQ/Celery with Redis) on EKS to handle data processing.
- Work directly with the Bedrock LLM layer and internal SDKs to ensure data flows seamlessly into the AI orchestration/scoring layer.
- Extend existing Python SDKs (e.g., gads-audience-insights) to cover new services like the ContentCreatorInsightsService.
- Own the User Acceptance Testing (UAT) for the data layer, ensuring high quality and catching edge cases without relying on a dedicated QA team.
- Work alongside internal DevOps/platform teams for CI/CD (GitHub Actions, ArgoCD) and IaC (Terraform), adapting quickly to internal standards.
MUST HAVES
- 5+ years of heavy Data Engineering or Backend experience focused heavily on data pipelines and infrastructure.
- Expert-level Python skills, specifically in building containerized microservices and workers (ECS/EKS).
- Deep experience with AWS data infrastructure,
📌 Senior Data Engineer (México)
🏢 Agileengine
📍 México