19 sep
|
Empresa reconocida
|
Xico
19 sep
Empresa reconocida
Xico
We are seeking a highly skilled
Senior Data Engineer
with strong experience in data integration, cloud data platforms, and modern data pipeline architecture. This role will be responsible for designing and building the data integration framework that will bring data from
Toast
into
Snowflake/Microsoft Fabric
, transform and organize the data using a
medallion architecture
, and ultimately prepare and deliver data into
NetSuite
.
The idóneo candidate has hands-on experience building data pipelines from APIs and event-driven systems, working with RESTful APIs, webhooks, event streams, and Azure services. This person should be comfortable taking an integration from initial discovery and pattern identification through production implementation.
Key Responsibilities
Design and build scalable data integration pipelines to extract data from
Toast
and other source systems.
Develop the architecture required to land Toast data into
Snowflake
and/or
Microsoft Fabric
.
Establish a robust data warehousing and integration layer using modern cloud data engineering practices.
Implement a
medallion architecture
to ingest, cleanse, transform, standardize, and prepare data for downstream consumption.
Analyze incoming data to identify patterns, relationships, anomalies, and appropriate transformation requirements.
Design and develop pipelines to move curated data into
NetSuite
.
Build and maintain integrations using
RESTful APIs
, webhooks, event streams, and event-driven architectures.
Work with
Microsoft Fabric
capabilities including Data Factory/pipelines, Event Streams, and Data Activator.
Leverage
Azure Event Hubs
and related Azure services to support event-driven data ingestion and processing.
Develop scalable, reliable, and maintainable data pipelines with appropriate monitoring, logging, and error handling.
Partner with business and technical stakeholders to understand data requirements and translate them into technical solutions.
Establish data quality, validation, and reconciliation processes across source, warehouse, and downstream systems.
Troubleshoot integration, pipeline issues, and optimize solutions for performance and reliability.
Help establish the foundational pipeline architecture for the upcoming
Toast implementation
, targeted for launch in mid-November.
Required Qualifications
5+ years of experience in data engineering, data integration, or a related field.
Strong hands-on experience with
Snowflake
, particularly in data integration and data warehousing environments.
Experience designing and implementing enterprise data pipelines and integration solutions.
Strong experience working with
RESTful APIs
and extracting data from API-based systems.
Experience building integrations using
webhooks, event streams, or event-driven architectures
.
Hands-on experience with
Microsoft Fabric
and its data engineering capabilities.
Experience with
Azure Event Hubs
or similar event-streaming technologies.
Experience implementing
medallion architecture
or comparable layered data architecture.
Strong SQL skills and experience with data transformation and modeling.
Experience working with structured and semi-structured data.
Ability to analyze unfamiliar data sources and identify data patterns and relationships.
Strong understanding of data warehousing, ETL/ELT, integration patterns, and data pipeline design.
Experience troubleshooting complex data integration issues.
Strong communication skills and the ability to work independently in a fast-paced environment.
Preferred Qualifications
Experience integrating
Toast
or other restaurant/POS platforms.
Experience integrating with
NetSuite
or other ERP platforms.
Experience with
Delta Lake
and/or lakehouse architectures.
Experience with
Microsoft Fabric Event Streams and Data Activator
.
Experience with Azure cloud services and event-driven architectures.
Experience designing APIs, webhooks, or event-based integrations.
Experience working with enterprise data platforms spanning multiple source and downstream systems.
Technical Environment
The successful candidate will ideally have experience across several of the following:
Snowflake
Microsoft Fabric
Azure
Azure Event Hubs
Fabric Data Pipelines
Fabric Event Streams
Data Activator
Delta Lake / Lakehouse
RESTful APIs
Webhooks
Event-driven architecture
SQL
ETL / ELT
Medallion Architecture
NetSuite
Toast
📌 Senior Data Engineer - Bilingual (Xico)
🏢 Empresa reconocida
📍 Xico