AgileEngine is seeking a Senior Data Engineer to modernize a 15-year-old data warehouse into a governed Databricks Lakehouse.
You will build batch and streaming pipelines with PySpark and Delta Lake, following a medallion architecture across bronze, silver, and gold layers.
Use AI tools like Claude and Copilot to speed up development.
Responsibilities include migrating legacy workloads, writing clean Python/SQL, and ensuring data quality and governance with Unity Catalog.
#J-*****-Ljbffr