Databricks Data Architect
Unison Group · Abou Dabi
Job description
About the role
A fast-growing Databricks practice delivering enterprise data and AI solutions across APAC is looking for a Lead Solution Architect - Data Engineering. You will be the technical anchor of the practice: leading solution design on client engagements, defending enterprise architectures in presales, and driving large-scale migration and cloud transformation programs. The role is hands-on leadership, combining whiteboard sessions with CTOs and debugging Spark pipelines.
Key responsibilities
- Own end-to-end architecture and design decisions on Databricks engagements, keeping solutions secure, scalable, performant and aligned with Lakehouse best practices.
- Lead delivery of production-grade data platforms: ingestion, transformation, orchestration, governance through Unity Catalog, and downstream BI/ML enablement.
- Lead large-scale migrations (legacy DW/ETL, Hadoop, on-prem estates) and cloud transformation projects to Databricks on Azure/AWS/GCP, including assessment, wave planning and cutover.
- Stay hands-on: performance tuning, debugging, code and design reviews, and setting engineering standards for the team.
- Defend solution designs in front of architecture boards, CIOs and CTOs, and drive presales end-to-end: discovery, solutioning, estimation, PoCs, RFPs and proposals.
- Mentor engineers, create accelerators and reusable assets, and turn delivery success into case studies and go-to-market offerings.
Required profile
- 10+ years in data engineering or architecture, with 3+ years on Databricks at enterprise scale.
- Experience in Databricks Partnered Projects (DPP) projects.
- Battle-tested in large migration and transformation programs.
- Strong presales instinct: designing, pricing and defending solutions.
- Databricks Data Engineer Professional or SA accreditation strongly preferred.
Required skills
- Deep Spark expertise: architecture, performance tuning, streaming, debugging.
- Lakehouse fluency: Medallion architecture, Delta Lake, Unity Catalog, governance, orchestration (Workflows, DLT/Lakeflow, Airflow, ADF); Microsoft Fabric exposure is a bonus.
- Strong Python, SQL and Scala, CI/CD for data platforms, and integration of ML/AI (MLflow, LLM APIs such as OpenAI and Anthropic).
Questions fréquentes
Why are you reporting this job?
Explore further
Salaries, guides and searches in the United Arab Emirates.
Salaries by job title
Apply in 30 seconds
Enter your email to apply. An account will be created automatically.
By continuing, you accept our terms of use.
Already have an account? Login
A question about this job?
Ask it here: you will get the full job summary by e-mail, right away.
Published 10 hours ago
Expires 1 month from now
4 views · 0 interested
Boost your chances
Upload your CV — we will match you with relevant openings.
Analyzing your CV...
Unison Group
Abou Dabi
Related job offers
-
AI Workflow Engineer - Presales
Opus Abou Dabi -
Research Assistant - Machine Learning and Explainable AI (XAI)
United Arab Emirates University, Department of Family Medicine Abou Dabi -
Services Analytics Team Leader
TALENTMATE Abou Dabi -
IT Supervisor
Rotana Hotels Dubai -
Senior Software Engineer - Backend (DMarts Network Management)
Delivery Hero Dubai