Lead Cloud Data Engineer (Kafka & Databricks) (México)

Lead Cloud Data Engineer (Kafka & Databricks) (México)

19 nov
|
QUADRANT RESOURCES
|
México

19 nov

QUADRANT RESOURCES

México

We are hiring for the role of Lead Cloud Data Engineer (Kafka & Databricks). Its a remote and contractor role. Interested candidates can apply via OCC.

:

?Mandatory Skills:

· Strong hands-on experience with Apache Kafka (Consumers, Consumer Groups, Offset Management, DLQ, Schema Registry, Security)

· Expertise in Databricks, Spark, Delta Lake, and Medallion Architecture (Bronze/Silver/Gold)

· Experience building real-time and batch data ingestion pipelines from Kafka to Databricks and SQL Server

· Strong knowledge of SQL Server, Stored Procedures, Data Modeling, MDM, and Data Reconciliation processes

· Experience with CI/CD pipelines, DevOps practices, Infrastructure as Code (Terraform/Bicep), and environment automation

· Expertise in monitoring, ing, observability, performance tuning, and production support

· Experience with cloud platforms such as Azure and related data services

· Experience with Master Data Management (MDM) platforms and healthcare data environments

· Knowledge of XML processing, backfeed services, and downstream system integrations

· Experience with Kafka Connect, Event-Driven Architecture, and Streaming Analytics• Azure Data Ecosystem: Hands-on experience building and managing cloud data solutions using Azure services such as Azure Data Lake Storage (ADLS Gen2), Azure Data Factory (ADF), and Azure Synapse Analytics.

· Databricks & Spark: Strong proficiency in Azure Databricks using PySpark, Spark SQL,



and Delta Lake for scalable data processing and lakehouse architecture.

· Real-Time Streaming (Kafka): Practical experience designing, building, and troubleshooting real-time event streaming pipelines using Apache Kafka (or Azure Event Hubs for Kafka).

· Informatica & MDM: Proven experience with Informatica (IICS / PowerCenter) and Master Data Management (MDM) concepts, including data modeling, match/merge rules, and golden record creation.

· Advanced SQL: Expert-level SQL skills for complex querying, data transformation, profiling, and performance tuning across relational and cloud data warehouses.'

Desired Skills

· Exposure to containerization technologies such as Docker and Kubernetes

· Familiarity with data governance, data quality frameworks, and security best practices

· Strong leadership, stakeholder management, and mentoring capabilities

· DevOps & Orchestration: Experience with CI/CD pipelines (Azure DevOps, GitHub Actions), Infrastructure as Code (Terraform/ARM), and workflow orchestration tools.

· Programming & Scripting: Proficiency in Python or Scala beyond PySpark for automation, API integrations, and custom data processing.

· Data Governance & Security: Familiarity with Unity Catalog, Microsoft Purview, RBAC security models, and data privacy compliance standards.

· Certifications: Microsoft Certified: Azure Data Engineer Associate, Databricks Certified Data Engineer, or Informatica certifications.

📌 Lead Cloud Data Engineer (Kafka & Databricks) (México)
🏢 QUADRANT RESOURCES
📍 México

Postulate a este anuncio

Muestra tus habilidades a la empresa, rellenar el formulario y deja un toque personal en la carta, ayudará el reclutador en la elección del candidato.

Suscribete a esta alerta:

Recibe por email las nuevas ofertas de trabajo para: lead cloud data engineer (kafka & databricks) (méxico) / méxico

Suscribete a esta alerta:

Recibe por email las nuevas ofertas de trabajo para: lead cloud data engineer (kafka & databricks) (méxico) / méxico