AWS Glue Data Engineer – Lakehouse Ingestion

About the role

A full-time AWS Glue Data Engineer position within the Data Factory Squad, based in Abu Dhabi or Dubai. The team migrates source systems into the Lakehouse ingestion zone by building scalable ingestion pipelines, optimising performance and keeping work aligned with architectural and data assurance standards.

Key responsibilities

• Build AWS Glue jobs for Bronze layer ingestion using defined standards and templates, choosing loading methods such as CDC, full load, delta or snapshot.
• Design and run historical loading to bring legacy data into the Lakehouse.
• Optimise Glue jobs (DPU allocation, parallelisation, partitioning) and align with platform teams on tooling.
• Migrate source tables to the Bronze layer, moving from manual approaches to AI-enabled acceleration, with version control and automated production deployment via Git and Terraform.
• Connect source systems to CDP, ensure jobs follow data contracts and are monitored, and prepare documentation for handover to operations.
• Work with the Data Architect on ingestion patterns, the Data Assurance Lead on quality checks, and platform engineers on tooling.

Required profile

• Preferred: 5+ years in data engineering with hands-on AWS Glue experience.
• Experience in financial services or banking is an advantage.
• Ability to work in a fast-paced environment and meet aggressive migration targets.
• Strong collaboration and communication skills; works with Jira and agile.

Required skills

• AWS Glue, PySpark and ETL pipeline development.
• Lakehouse architecture and Medallion design principles.
• CDC, delta loads and historical data ingestion.
• Glue, S3, Athena, Lambda; Git and Terraform for CI/CD.
• Familiarity with data quality frameworks such as Soda Core is a plus.