19 ago
|
Klaxontech
|
Zacatecas
19 ago
Klaxontech
Zacatecas
**Job Title**: Databricks Data Warehouse Architect
**Location**: Remote (LATAM / USA)
**Duration**: 1+ Year Contract
**About the Role**:
We are seeking a **hands-on Data Warehouse Architect** with strong expertise in **Databricks (DBX)** and **AWS-native data services** to design and implement a modern data warehouse from the ground up. This role involves architecting scalable pipelines, optimizing lakehouse performance, and integrating real-time and batch data sources across AWS.
**Key Responsibilities**:
- Design and deploy a new **Databricks Lakehouse** instance for enterprise-scale data needs.
- Architect and implement **data ingestion pipelines** using Spark (PySpark/Scala) and Delta Lake.
- Integrate AWS services (**S3, Glue, Athena, Redshift, Lambda**) with Databricks for performance and scalability.
- Define **data models**, optimize queries, and establish governance best practices.
- Collaborate with product, data science, and DevOps teams to streamline workflows.
- Implement **CI/CD pipelines** using GitOps and Infrastructure-as-Code frameworks.
- Monitor and troubleshoot data jobs, ensuring performance optimization and reliability.
**Required Skills & Experience**:
**Databricks / Lakehouse Architecture**
- End-to-end setup of Databricks workspaces and Unity Catalog.
- Strong understanding of **Delta Lake internals**, file compaction, and schema enforcement.
- Advanced **PySpark** and **SQL** development for ETL and data transformations.
**AWS Native Integration**
- Deep experience with **AWS Glue, S3, Redshift Spectrum, Lambda, and Athena**.
- Knowledge of **IAM** and **VPC** configurations for secure integrations.
**Data Warehousing & Modeling**
- Expertise in **dimensional modeling** (star/snowflake schemas).
- Proven experience with **lakehouse design patterns** for mixed workloads.
**Automation & DevOps**
- Experience with **CI/CD for data engineering** (DBX, Terraform, GitHub Actions, Azure DevOps).
- Proficiency in **monitoring tools** such as CloudWatch, Datadog, or New Relic.
**Bonus / Nice to Have**:
- Experience with **gaming** or **real-time analytics** environments.
- Familiarity with **Airflow, Kafka, or EventBridge**.
- Knowledge of **data privacy/compliance** (GDPR, CCPA).
**Job Types**: Full-time, Contract
Pay: $35.00 - $36.00 per hour
📌 Senior Databricks Architect (Zacatecas)
🏢 Klaxontech
📍 Zacatecas