We are building cloud-scale data pipelines and platforms as a Lead Data Software Engineer to enable analytics, reporting, and AI-driven initiatives. You will collaborate with Product, Engineering, and Business teams to deliver reliable solutions using Azure Databricks, Spark, Kafka, and modern governance practices.ResponsibilitiesDesign scalable batch and streaming data pipelinesBuild and fine-tune Databricks, Spark, and Kafka-based solutionsImplement data quality, governance, and observability standardsDevelop data models and reporting foundations for analytics and AI initiativesCollaborate with Product, Engineering, and Business teams to deliver data-driven solutionsSupport enterprise reporting, dashboards, and self-service analytics platformsLeverage AI tools such as Claude Code, GitHub Copilot, and similar platforms for development, testing, and productivity improvementsApply MCP, prompt engineering, and multiple LLMs in AI-assisted development workflowsRequirementsProven track record with 5+ years of experience in data engineering or a related fieldHands-on proficiency in SQL, Python, PySpark, Scala, and JavaDeep expertise in Apache Spark, Spark SQL, Kafka, and Delta LakeStrong experience with Azure Databricks, Unity Catalog, and Databricks Asset Bundles (DAB)Solid familiarity with Azure Data Factory (ADF), ADLS Gen2, Azure Key Vault, Azure Cosmos DB,



and Azure MonitorThorough knowledge of Data Modeling, Data Quality, Data Governance, and PII HandlingDemonstrated background in Medallion Architecture (Bronze/Silver/Gold), CDC, and SCD Type 1 & Type 2Practical competency in Azure DevOps, Git, CI/CD, and GradleEnglish proficiency at B2+ (Upper-Intermediate) levelNice to haveFamiliarity with Tableau, ThoughtSpot, Cognos, and Data Visualization Best PracticesKnowledge of Semantic Layer Concepts, AI/BI Dashboards, and Databricks GenieUnderstanding of scalable data platforms, analytics, and reporting solutionsWe offerInternational projects with top brandsWork with general teams of highly skilled, diverse peersHealthcare benefitsEmployee financial programsPaid time off and sick leaveUpskilling, reskilling and certification coursesUnlimited access to the LinkedIn Learning library and 22,000+ coursesGlobal career opportunitiesVolunteer and community involvement opportunitiesEPAM Employee GroupsAward-winning culture recognized by Glassdoor, Newsweek and LinkedInEPAM is an Equal Opportunity Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, national origin, age, sexual orientation, gender identity or expression, disability, protected veteran status, or any other characteristic protected by applicable law.
#J-18808-Ljbffr

📌 Lead Data Software Engineer (Xico)
🏢 Epam Systems
📍 Xico