PROGRAMMING.COM is seeking a Data Engineer to build and operate robust data pipelines using Databricks, Airflow, or Dagster.
You will develop efficient ETL/ELT workflows in Python and SQL for batch and streaming workloads, and collaborate with ML teams to prepare high‐quality datasets for training and production use.You will model and maintain Delta/Parquet/Iceberg data assets, implement orchestration and monitoring, and ensure data quality with validation and audit logging.
#J-*****-Ljbffr