06 sep
|
FlexTal Staffing
|
Guadalajara
06 sep
FlexTal Staffing
Guadalajara
Description
A rapidly scaling Health-Tech startup is developing a next-generation platform to deliver an industry-leading consumer healthcare experience powered by AI. The Azure-native ecosystem supports telemedicine and telehealth web and mobile applications while redefining the company’s data, analytics, and AI foundation.
Role OverviewWe are seeking an experienced Azure Data Engineer to design and implement high-quality batch ingestion pipelines from key data sources (EMR, claims, CRM) into Medallion-zone architecture (Bronze, Silver, Gold). The role focuses on embedding data quality, lineage, and error handling within a metadata-driven, reusable framework that ensures scalability and transparency across the enterprise data platform.
Key Responsibilities• Build and optimize Azure Data Factory (ADF) pipelines, dataflows, and activities (Copy, Mapping Data Flows, Notebooks) for ingestion and ELT, leveraging Key Vault for secrets management.
• Implement schema drift handling, incremental loads, and retry/error notification patterns.
• Develop Silver/Gold transformations,
conforming dimensions and KPIs according to business-defined semantic models.
• Apply data quality checks, publish metrics to monitoring dashboards, and lead issue remediation.
• Register and maintain assets in Microsoft Purview, ensuring data cataloging, PII classification, and RBAC alignment.
• Document pipelines, author operational runbooks, and actively participate in peer code reviews and on-call rotations.
Expected Outcomes• 2–3 data sources onboarded per quarter, each validated with signed-off data quality results and lineage diagrams.
• Parameterized pipelines with reusable templates and environment-aware configurations.
• Consistent delivery of reliable, compliant, and performant data pipelines supporting analytics and AI workloads.
Requirements
Qualifications• 4–7 years of hands-on experience in data engineering within Azure ecosystems.
• Strong command of ADF and SQL, with working kno
📌 Azure Data Engineer (Guadalajara)
🏢 FlexTal Staffing
📍 Guadalajara