At Improving, we deliver future-ready solutions across AI, Data, and Applications, modernizing legacy systems and building cloud-native platforms through collaborative, long-term partnerships. In this role, we’ll place a Nearshore engineer on a client-facing team focused on converting SAS code to Python and SQL running on Databricks. You’ll work with existing accelerators to accelerate delivery, then take ownership of end-to-end deliverables—from implementing reliable pipelines and validation logic, to deployment and operational troubleshooting. You’ll partner closely with client and internal stakeholders to ensure converted outputs are accurate, reproducible, and production-ready on Databricks, leveraging modern controls such as Unity Catalog, Databricks Asset Bundles, and GitLab CI/CD.

Functions

We’ll rely on you to drive the end-to-end conversion delivery from SAS inventories to validated Python/SQL outputs on Databricks, with a strong focus on pipeline reliability and data validation.

• Pipeline engineering:



Build and run pipelines that process SAS inventories and produce converted outputs.
• Quality and parity validation: Validate converted code for parity against SAS outputs (e.g., row counts, checksums, schema, and data types).
• Deployment ownership: Own deployments through Databricks Asset Bundles (DABs) and GitLab CI/CD, ensuring repeatable releases.
• Databricks governance: Manage Unity Catalog objects, permissions, and promotion across environments.
• Operational excellence: Troubleshoot job failures and performance issues, and take preventive actions to improve pipeline stability.
• Performance tuning: Apply tuning techniques for Apache Spark and Delta Lake to meet reliability and execution-time expectations.
• Data reconciliation: Use data validation and reconciliation practices to ensure correctness and consistency.
• Infrastructure-as-code mindset: Implement DAB-based deployment patterns and support automated, testable delivery workflows.
• Client

📌 Sas to Databricks Migration Engineer AI (México)
🏢 Improving South America
📍 México