Senior Data Engineer – BigQuery, SQL & Spark

About the role

We are looking for a hands‑on Senior Data Engineer to join a major data transformation programme in Dubai. The role is delivery‑focused, working with existing production pipelines, understanding end‑to‑end data flows and assessing the impact of changes across complex environments.

Key responsibilities

• Maintain and enhance production ETL/ELT pipelines built on Google BigQuery, Spark and PySpark.
• Analyse data flows from source systems through extraction, transformation, loading and downstream consumption.
• Perform impact analysis and dependency tracing to identify downstream effects of schema or data changes.
• Design and execute regression testing and validation of data pipelines.
• Estimate remediation effort and create prioritized, timeline‑based delivery plans.
• Document pipeline architecture and manage version control.

Required profile

• Strong hands‑on experience with Google BigQuery.
• Expert‑level SQL skills, including complex queries, joins, CTEs and window functions.
• Solid knowledge of Spark and PySpark fundamentals.
• Proven experience building and supporting production ETL/ELT pipelines.
• Experience with schema migrations, impact analysis and dependency tracing.
• Ability to conduct regression testing and produce detailed documentation.

Required skills

• Google BigQuery
• SQL
• Spark
• PySpark
• ETL/ELT pipelines
• Impact analysis
• Dependency tracing
• Schema migrations
• Regression testing
• Version control