**DESCRIPTION**:
Join EPAM as a **Senior Data Engineer specializing in Azure Databricks.**
In this role, you'll focus on building a metadata-driven framework for the transformation layer in Azure Databricks and migrating existing jobs to it.
If you have hands-on coding experience with Databricks Jobs using Python and PySpark, experience in Azure cloud data platform, and excellent problem-solving skills, we'd love to hear from you.
EPAM is a leading general provider of digital platform engineering and development services. We are committed to having a positive impact on our customers, our employees, and our communities. We embrace a dynamic and inclusive culture. Here you will collaborate with multi-national teams, contribute to a myriad of innovative projects that deliver the most creative and cutting-edge solutions, and have an opportunity to continuously learn and grow. No matter where you are located, you will join a dedicated, creative, and diverse community that will help you discover your fullest potential.
RESPONSIBILITIES
- Re-engineer existing Databricks jobs to improve efficiency and performance
- Build a configuration/metadata-driven framework for data transformation and orchestration
- Implement and orchestrate Databricks Jobs
- Develop and implement a Data Ingestion Framework, identifying patterns for initial and incremental data loads
- Document all data engineering processes and frameworks for knowledge sharing and future reference
- Reverse-engineer and troubleshoot existing jobs
- Handle Ad-Hoc L3/L4 Client Support Requests, including issue troubleshooting and bug fixing.



This role will be rotated within the team, with mínimal support load expected
**REQUIREMENTS**:
- Hands-on coding experience with Databricks Jobs using Python and PySpark
- Hands-on experience with Data Lake or Data Platform implementation
- Good understanding of relational and NoSQL data stores, methods, and approaches (star and snowflake, dimensional modeling)
- Experience in Azure cloud data platform, specifically Azure Databricks, Delta Lake, ADSL2, Azure Data Factory, Azure SQL Database, Azure Functions
- Expertise in developing data ingestion strategies for both initial and incremental data loads, including various integration patterns (REST, Files, DB Connect)
- Solid understanding of data engineering best practices and the ability to implement these in a team setting
- Excellent problem-solving skills and the ability to lead complex data engineering projects
- Strong communication and collaboration skills to work effectively with both technical and non-technical stakeholders
- Relevant certifications in Azure, Databricks, and data engineering methodologies are a significant plus
NICE TO HAVE
- Certifications in Azure, Databricks, and data engineering methodologies




- Experience with Data catalog and Lineage integration
TECHNOLOGIES
- Databricks
- Python
- PySpark
- Data Lake
- Azure Databricks
- Delta Lake
- ADSL2
- Azure Data Factory
- Azure SQL Database
- Azure Functions
WE OFFER
- Career plan and real growth opportunities
- Unlimited access to LinkedIn learning solutions
- International Mobility Plan within 25 countries
- Constant training, mentoring, online corporate courses, eLearning and more
- English classes with a certified teacher
- Support for employee’s initiatives (Algorithms club, toastmasters, agile club and more)
- Enjoyable working environment (Gaming room, napping area, amenities, events, sport teams and more)
- Flexible work schedule and dress code
- Collaborate in a multicultural environment and share best practices from around the globe
- Hired directly by EPAM & 100% under payroll
- Law benefits (IMSS, INFONAVIT, 25% vacation bonus)
- Major medical expenses insurance: Life, Major medical expenses with dental & visual coverage (for the employee and direct family members)
- 13 % employee savings fund, capped to the law limit
- Grocery coupons
- 30 days December bonus
- Employee Stock Purchase Plan
- 12 vacations days plus 4 floating days
- Official Mexican holidays, plus 5 extra holidays (Maundry Thursday and Friday, November 2nd, December 24th & 31st)
- Relocation bonus: transportation, 2 weeks of accommodation for you and your family and more
- Monthly non-taxable amount for the electricity and internet bills
CONDITIONS

📌 Azure Databricks Software Engineer (México)
🏢 Epam Systems
📍 México