Databricks Data Quality & Remediation Architect Lead

About the role

This senior, hands‑on position will lead the design and delivery of an enterprise‑scale Data Quality & Remediation platform on Databricks for a major UAE data transformation programme. The role combines deep Databricks architecture, data engineering, and technical leadership.

Key responsibilities

• Design and implement a scalable Data Quality & Remediation Engine on Databricks.
• Define architecture for data profiling, quality rules, exception management, root‑cause analysis and remediation.
• Build a metadata‑driven data‑quality framework and define Bronze, Silver and Gold processing layers.
• Collaborate with Data Governance teams and Data Stewards on Critical Data Elements and quality processes.
• Integrate Microsoft Purview for governance, lineage and auditability.
• Lead the development team, providing hands‑on technical direction.
• Own data‑quality reporting, including KPIs, exceptions and remediation activity.

Required profile

• 5+ years of experience in data engineering, Databricks or related roles.
• 2+ years in a Lead or Architect position.
• Strong technical leadership and stakeholder‑management skills.
• Experience with enterprise data governance and lineage.

Required skills

• Databricks SQL
• Azure Databricks
• Delta Lake
• Unity Catalog
• Lakeflow
• Workflows
• Python
• PySpark
• Azure DevOps
• ADLS Gen2
• Data Factory
• Microsoft Purview
• SAP S/4HANA (optional)
• SAP BW (optional)
• Oracle Fusion (optional)
• MLflow (optional)
• Mosaic AI (optional)
• Databricks Asset Bundles (optional)

What we offer

• Opportunity to shape the architecture of a major enterprise data platform.
• Lead delivery on complex data‑quality challenges at scale.
• Competitive rate, dependent on experience.
• Initial 6‑month contract with strong likelihood of extension.