08 sep
|
Pyramid Consulting
|
México
08 sep
Pyramid Consulting
México
ROLE SUMMARY
Data Integration Engineer specialized in designing, developing, and operating enterprise data pipelines using ETL tools, with Informatica IDMC (Intelligent Data Management Cloud / IICS) as the primary platform.
Able to work across cloud-agnostic environments, including Azure, AWS, and GCP.
REQUIRED TECHNICAL SKILLS
Informatica IDMC – Integration Core
Cloud Data Integration (CDI)
- Mapping Designer
- SQL ELT with pushdown optimization (full/source/target)
- Taskflows
- Mapping partitioning
- Dynamic Mappings
- Parameterization
- File listeners
- Intelligent Structure Models (CLAIRE-powered)
- Performance tuning
Cloud Mass Ingestion (CMI)
Experience with batch and near-real-time ingestion from heterogeneous sources across:
- Mass Ingestion Databases (CDC)
- Files
- Applications
- Streaming
Cloud Application Integration (CAI)
- Process Designer
- Service connectors
- Guides
- Business processes
- API and microservices integration
PowerCenter to IDMC
- Migration and modernization of on-premises pipelines
- Structured migration methodology
- CDI-PC
- Migration accelerators
Platform Operations
- Administration of Secure Agents
- Runtime environment management
- Secure Agent Groups
- Monitoring
- SLA management
AI-Assisted Development – CLAIRE
- CLAIRE GPT / CLAIRE Copilot: Assisted generation of mappings, debugging of transformations, and automated pipeline documentation through natural language within IDMC.
- Awareness of new agentic capabilities (CLAIRE Agents, Fall 2025 release) for headless ingestion and transformation flows.
Platform FinOps
- Understanding of the IPU (Informatica Processing Units) consumption model.
- Per-service cost optimization.
Cloud-Agnostic Technologies
AWS — Core to the Role
- AWS Glue
- Amazon S3
- AWS Step Functions
- Amazon Athena
Azure
- Azure Data Factory (ADF)
Infrastructure as Code & CI/CD
- Terraform
- CloudFormation
- GitHub / Bitbucket
- Jenkins
Databases & Platforms
- Advanced SQL: Oracle, SQL Server, PostgreSQL, Amazon Redshift, Databricks SQL
- NoSQL: MongoDB, DynamoDB (desirable)
- Data Warehouse architecture patterns
- Data Lake architecture patterns
- Lakehouse architecture patterns
CERTIFICATIONS
Core
- Informatica Cloud Data Integration Developer, Professional Certification (ICP)
Relevant
- Informatica IDMC Foundation / Data Engineering Foundation
Desirable
- Informatica Cloud Application Integration Developer, Professional Certification
- Databricks Certified Data Engineer Associate
Complementary
- Microsoft Certified: Azure Data Engineer Associate (DP-203)
- AWS Certified Data Engineer / AWS Certified Data Analytics Specialty
KEY RESPONSIBILITIES
- Design and implement ingestion, transformation, and distribution pipelines using CDI and Cloud Mass Ingestion.
- Develop data pipelines using the following AWS cloud services:
- AWS Glue
- Amazon S3
- AWS Step Functions
- Amazon Athena
- Extract and process data from heterogeneous sources using AWS services.
- Provide support for incidents related to data pipelines and data publishing, ensuring the quality and reliability of services provided to data users.
- Support infrastructure components, including:
- EC2 Linux and Windows machines
- S3 buckets
- SNS
- EventBridge
- Operate and maintain integration infrastructure, including Secure Agents and runtime environments, across Azure and AWS while meeting SLA standards.
- Apply CLAIRE GPT / CLAIRE Copilot to optimize the mapping development lifecycle and improve development efficiency.
📌 Data Integration Engineer (México)
🏢 Pyramid Consulting
📍 México