Azure Data Engineer SeniorRequirements
- Over 4 years of experience designing and operating end‑to‑end data pipelines
- Experience working with structured and semi‑structured data
- Experience ingesting data from multiple sources, SQL databases, REST APIs, CSV, XML, third‑party platforms
- Over 4 years of experience with Azure Data Factory, orchestration, scheduling
- Experience developing Azure Functions and Logic Apps
- Over 4 years of experience with Azure Databricks, cluster management, governance
- Proficiency in Python and PySpark for data processing
- Knowledge of data architecture patterns, medallion architecture, bronze, silver, gold
- Strong understanding of data modeling best practices
- Experience with data governance, access control, classification, lineage
- Experience managing Azure storage, ADLSGen2, partitioning, lifecycle policies
- Ability to validate data quality and ensure data integrity
- Strong troubleshooting skills for pipelines and performance issues
- Experience documenting architecture, data flows, and runbooks




- Strong collaboration skills with analytics, IT, and business teams
- Experience working in cloud‑native data platforms (Azure)

Responsibilities
- Design, develop, and maintain end‑to‑end data pipelines
- Ingest data from multiple sources, SQL, APIs, flat files, third‑party systems
- Build and manage Azure Data Factory pipelines for orchestration
- Develop Azure Functions and Logic Apps for integrations
- Administer and manage Azure Databricks environments, clusters, governance
- Implement data transformation logic using Python and PySpark
- Define and enforce data architecture standards, bronze, silver, gold layers
- Implement and maintain data governance policies
- Manage Azure Data Lake Storage, organization, partitioning, lifecycle
- Validate and monitor data quality throughout pipelines
- Collaborate with analysts and developers to deliver curated datasets
- Troubleshoot pipeline failures, data discrepancies, performance bot

📌 Azure Data Engineer (Monterrey)
🏢 SOFTTEK
📍 Monterrey