Before you apply, please get familiar with Luxoft: Luxoft locations: https://career.luxoft.com/location s/Logeek Magazine: https://career.luxoft.com/logeek-magazin e/Luxoft Alumni Club: https://career.luxoft.com/alumni / Project Descripti on:
The primary goal of the project is the modernization, maintenance and development of an eCommerce platform for a big US-based retail company, serving millions of omnichannel customers each w eek.Solutions are delivered by several Product Teams focused on different domains - Customer, Loyalty, Search and Browse, Data Integration, C art.Current overriding priorities are new brands onboarding, re-architecture, database migrations, migration of microservices to a unified cloud-native solution without any disruption to busin ess.
Responsibili ties
We are looking for Senior Data Engineer to implement a solution for a big retail company. The main focus is to support processing of big data volumes and integrate solution to current archite cture.
Mandatory Skills Descr iption
- Overall years of experience req uired 8+• Strong, recent hands-on expertise with Azure Data Factory and Synapse is a must (3+
years).
- Strong expertise in designing and implementing data models, including conceptual, logical, and physical data models, to support efficient data storage and re trieval.
- Strong knowledge of Microsoft Azure, including Azure Data Lake Storage, Azure Synapse Analytics, Azure Data Factory, and Azure Databricks,
pySpark for building scalable and reliable data so lutions.
- Extensive experience with building robust and scalable ETL/ELT pipelines to extract, transform, and load data from various sources into data lakes or data war ehouses.
- Ability to integrate data from disparate sources, including databases, APIs, and external data providers, using appropriate techniques such as API integration or message queuing.
- Proficiency in designing and implementing data warehousing solutions (dimensional modeling, star schemas, Data Mesh, Data/Delta Lakehouse, Dat a Vault)• Proficiency in SQL to perform complex queries, data transformations, and performance tuning on cloud-based data s torages.
- Experience integrating metadata and governance processes into cloud-based data p latforms• Certification in Azure, Databricks, or other relevant technologies is an added a dvantage• Experience with cloud-based analytical da tabases.
- Experience with Azure MI, Azure Database for Postgres, Azure Cosmos DB, Azure Analysis Services, and I nformix.
- Experience with Python and Python-based ET
L tools.
- Experience with shell scripting in Bash, Unix or windows shell is pre ferable.
- Demonstrated ability to lead cross-functional engineering teams, define technical strategy and architecture, drive delivery of complex data platforms, mentor engineers, and effectively communicate with stakeholders at all organizational levels.
📌 Senior Data Engineer (México)
🏢 Luxoft
📍 México