Data Engineer – Cloud‑Native AI‑Enabled Financial Services

About the role

We are partnering with a leading UAE institution that is building a digital‑first, AI‑enabled financial services organisation. As a Data Engineer you will design and operate the data pipelines and lakehouse components that power the bank’s operations, analytics, regulatory reporting and AI capabilities.

Key responsibilities

• Build and operate batch, streaming and CDC ingestion pipelines for core banking, payments and transactional systems.
• Develop scalable data products, lakehouse components and data marts using cloud‑based platforms such as Databricks.
• Deliver AI‑ready datasets, feature pipelines, vector pipelines and retrieval corpora to support machine‑learning use cases.
• Implement data quality controls, data contracts, metadata management and lineage across all pipelines.
• Maintain regulatory and management reporting feeds to satisfy CBUAE reporting and IFRS 9 requirements.
• Promote engineering excellence through automated testing, CI/CD, observability, monitoring and AI‑assisted development practices.

Required profile

• 6+ years of hands‑on data engineering experience, preferably in banking, fintech or another highly regulated environment.
• Proven experience building and operating cloud‑based data pipelines and lakehouse platforms (e.g., Databricks).
• Strong background with streaming platforms, CDC ingestion and event‑driven data architectures.
• Hands‑on experience delivering data pipelines for AI/ML, feature stores, vector databases or retrieval systems.
• Deep knowledge of Python, SQL, Spark, dbt, Kafka, orchestration tools and CI/CD pipelines.
• Familiarity with modern AI‑assisted development tools and software‑engineering best practices.

Required skills

• Python
• SQL
• Apache Spark
• dbt
• Kafka
• Databricks (or equivalent lakehouse platform)
• CI/CD pipelines
• Streaming platforms
• CDC ingestion
• Orchestration tools (e.g., Airflow)
• Feature stores and vector databases
• AI‑assisted development tools