Assistant Manager – Data Engineering

About the role

Dubai Holding Entertainment is seeking an Assistant Manager – Data Engineering to design, develop and optimise scalable data platforms and pipelines. Based in Dubai, this full‑time position will deliver reliable, secure and high‑performing data solutions that enable analytics, reporting and informed business decisions.

Key responsibilities

• Design, develop and maintain scalable data pipelines and ETL/ELT workflows using Azure Databricks and Azure Data Factory.
• Build and optimise PySpark jobs for batch and near real‑time processing.
• Implement data models, schemas, stored procedures and SQL Server solutions for analytics.
• Establish CI/CD pipelines and automate deployments with Azure DevOps or comparable tools.
• Ensure data quality, integrity and reliability through validation, monitoring and alerting.
• Collaborate with data analysts, data scientists and business stakeholders to translate requirements into robust technical solutions.

Required profile

• At least eight years of professional experience in data engineering or a comparable data‑focused role.
• Bachelor’s or master’s degree in Computer Science, IT, Engineering or related discipline, or equivalent experience.
• Strong hands‑on experience with Azure Databricks, Azure Data Factory and SQL Server.
• Proven ability to work in an agile, collaborative environment and provide technical leadership.

Required skills

• Azure Databricks (Spark, cluster management, notebooks)
• Azure Data Factory (pipelines, triggers, linked services)
• PySpark and Spark SQL
• SQL Server, T‑SQL, indexing, stored procedures
• Azure DevOps, Git, CI/CD pipelines
• Power BI integration
• Knowledge of Kafka or Event Hubs (advantageous)
• Python and Palantir Foundry (added advantage)

What we offer

• Competitive compensation and comprehensive benefits package.
• Opportunities for career development within a dynamic, diverse entertainment group.
• Collaborative and creative work environment that values innovation.