Azure Databricks DevOps Engineer (6‑week contract)

About the role

Our client in Abu Dhabi is seeking an experienced Azure Databricks DevOps Engineer for a 6‑week contract. You will design and automate release pipelines across development, UAT and production environments, working onsite for the initial four weeks.

Key responsibilities

• Build Azure DevOps YAML pipelines to deploy code, SQL views and Databricks jobs.
• Automate Databricks jobs via REST APIs using service principals and manage environment‑specific configuration, secrets and Unity Catalog permissions.
• Integrate SQL data‑quality checks into pipelines and configure failure alerts, release documentation and rollback procedures.

Required profile

• Minimum 2 years of hands‑on experience deploying to Azure Databricks.
• Strong background in DevOps or platform engineering with proven Azure DevOps YAML skills.

Required skills

• Azure DevOps YAML pipelines, variable groups, approval gates, environment‑based releases
• Databricks Jobs, Unity Catalog, SQL warehouses, Databricks REST API
• Python or PowerShell scripting for API automation
• Microsoft Entra ID service principals, OAuth, Databricks secret scopes
• Spark SQL, Git pull requests, automated pipeline checks, SQL data‑quality checks