We are looking for a highly skilled and experienced **Lead Data Software Engineer** to join our collaborative team.
As part of our engineering team, you will lead efforts to design, build, and optimize data pipelines and workflows, enabling our business to deliver innovative financial solutions for our customers across 1,500 branches and online platforms. Your expertise in data engineering, leadership skills, and passion for leveraging cutting-edge technologies will drive meaningful business outcomes, inspire your team, and enhance our data-driven decision-making capabilities.
**Responsibilities**
- Lead the design and development of ingestion pipelines from multiple sources to raw data storage (e.g., S3) using micro-batch, batch, and streaming processes
- Oversee and improve the implementation of data quality checks, logging, and monitoring frameworks for reliable pipeline operations
- Manage and ensure optimal functionality of multiple data feeds to external systems using micro-batch and streaming patterns
- Evaluate, recommend, and propose advancements to the team’s data platform architecture to improve scalability and align with business goals
- Ensure high availability, performance optimization, and reliability of large-scale distributed data systems
- Collaborate with cross-functional teams to deploy and operationalize pipelines, while ensuring seamless integration of data solutions into production environments
- Mentor and provide technical guidance to data engineers, fostering a collaborative and innovative work environment
- Proactively track emerging technologies and industry developments, introducing innovative solutions to enhance team capabilities
- Lead efforts in establishing data governance practices and ensuring compliance with all regulatory and privacy standards
**Requirements**:




- 5+ years of experience as a data engineer, preferably in consumer finance or similar industries involving consumer loans, collections, servicing, optional products, or insurance sales
- 1+ years of relevant leadership experience
- Proven ability to lead and mentor engineering teams, cultivating growth and technical excellence
- Advanced background in math, statistics, computer science, data science, or a related discipline
- Expert-level programming skills in one or more languages such as Snowflake, Java, Scala, Python, or C#
- Extensive production experience with technologies such as HDFS, YARN, Hive, Spark, Kafka, Oozie/Airflow, and containerization tools like Docker/Kubernetes
- Advanced proficiency in data mining and programming tools (e.g., SAS, SQL, R, Python) and database systems including PostgreSQL, Redshift, Snowflake, or Greenplum
- Strong expertise in business intelligence and analytical tools, technologies, and techniques for generating actionable data insights
- Demonstrated history of deploying, managing, and automating scalable data pipelines on cloud platforms, including AWS, with storage and processing tools
- Ability to quickly learn, adapt, and integrate emerging tools and technologies into existing workflows
- Exceptional communication skills, with a strong ability to explain technical concepts and solutions to both technical and non-technical stakeholders




- Deep understanding of performance optimization for large-scale distributed systems and Big Data infrastructures
- Fluency in English, with a proficiency level of B2+ or higher
**Nice to have**
- AWS certification validating advanced expertise in cloud technologies
- Practical experience with Spark Streaming, Kafka Streaming, or Kafka Connect for real-time, high-throughput data processing
- Hands-on expertise with the ELK Stack (Elasticsearch, Logstash, Kibana) for powerful monitoring and analytics solutions
- Familiarity with NoSQL databases like Cassandra or MongoDB for scalable, non-relational data storage
- Experience with CI/CD tools such as Jenkins or GitLab, along with tools like Jira and Confluence for effective project management and collaboration
**We offer**
- Career plan and real growth opportunities
- Unlimited access to LinkedIn learning solutions
- International Mobility Plan within 25 countries
- Constant training, mentoring, online corporate courses, eLearning and more
- English classes with a certified teacher
- Support for employee’s initiatives (Algorithms club, toastmasters, agile club and more)
- Enjoyable working environment (Gaming room, napping area, amenities, events, sport teams and more)
- Versátil work schedule and dress code
- Collaborate in a multicultural environment and share best practices from around the globe
- Hired directly by EPAM & 100% under payroll
- Law benefits (IMSS, INFONAVIT, 25% vacation bonus)
- Major medical expenses insurance: Life, Major medical expenses with dental & visual coverage (for the employee and direct family members)
- 13 % employee savings fund, capped to the law limit
- Grocery coupons
- 30 days December bonus
- Employee Stock Purchase Plan
- 12 vacations days plus 4

📌 Lead Data Software Engineer (México)
🏢 Epam Systems
📍 México