10 ago
|
The Ksquare Group
|
Ciudad de México
10 ago
The Ksquare Group
Ciudad de México
Mexico City, MX
Full-time
Remote
**Job Summary**:
**Key Responsibilities**:
Design, develop, and deploy batch and streaming data pipelines using BigQuery, DataFlow, DataProc, Cloud Composer, and Pub/Sub
Build robust ETL/ELT workflows in Python, SQL, or Spark that deliver clean, reliable data to consumers
Implement data quality checks, logging, and alerting mechanisms to ensure pipeline health
Collaborate with data architects to align on data modeling standards and integration patterns
Automate and manage data pipeline deployment using CI/CD tools such as Cloud Build, GitHub Actions, or Terraform
Optimize performance and cost of BigQuery workloads, partitioning strategies, and materialized views
Manage metadata, lineage, and governance using Data Catalog, Collibra, or similar tools
Ensure security best practices across data platforms, including IAM controls, KMS encryption, and audit logging
Participate in sprint planning, code reviews, and Agile ceremonies to drive engineering quality and velocity
**Required Qualifications**:
5+ years of experience as a Data Engineer or in a similar data development role
2+ years of hands-on experience with Google Cloud Platform (GCP) services
Strong proficiency in SQL, Python, and Spark
Experience building and maintaining pipelines using Cloud Composer (Airflow), DataFlow, or DataProc
Familiarity with BigQuery performance tuning, optimization, and partitioning
Hands-on with CI/CD for data workflows, Infrastructure as Code (e.g., Terraform)
Understanding of data security principles, including encryption and access control in cloud environments
Knowledge of data governance, quality, and lineage practices
**Preferred Qualifications**:
**GCP certifications**: Professional Data Engineer or Cloud Developer
Experience with streaming data pipelines using Pub/Sub or Kafka
Exposure to DataOps frameworks and tools like Great Expectations or dbt
Familiarity with metadata and cataloging tools like Data Catalog, Alation, or Atlan
Experience in containerized environments using Docker or Kubernetes for data services
**Soft Skills**:
Strong analytical and problem-solving skills
Clear written and verbal communication
Collaborative mindset and proactive attitude toward ownership and delivery
Ability to work effectively in cross-functional Agile teams
Why will you love working with us?
We thrive to reach out to tomorrow.
We are a world class team who work together across cultures and disciplines.
Transparency and challenging projects that will let you grow and learn.
We offer to you trust, sensibility and welfare, because you are important to us.
📌 Gcp Data Engineer (Ciudad de México)
🏢 The Ksquare Group
📍 Ciudad de México