Jobiglo

No results.

Senior Data Engineer

EPAM Systems · Abou Dabi

Senior 🇬🇧 English
Databricks PySpark SQL Delta Lake Spark performance tuning Git CI/CD Data validation

Job description

About the role

We are seeking a Senior Data Engineer to join our Abu Dhabi team on-site. You will lead the migration of a large‑scale data platform to modern technologies, building production‑ready pipelines in a fast‑moving delivery environment.

Key responsibilities

  • Design, build, optimise and productionise data pipelines on Databricks using PySpark and SQL.
  • Re‑engineer and migrate transformation logic from a legacy platform to Databricks.
  • Design and execute data validation and reconciliation processes to ensure cross‑platform accuracy.
  • Tune performance through partitioning, Delta optimisation, cluster configuration and ingestion strategies.
  • Contribute to medallion‑layer design and implement data‑quality frameworks.
  • Review code, mentor junior engineers and promote best practices.
  • Work within Git‑based CI/CD pipelines and follow Agile delivery processes.

Required profile

  • 7+ years of hands‑on data engineering experience.
  • Strong proficiency with Databricks, PySpark, SQL and Delta Lake.
  • In‑depth knowledge of ingestion patterns, Spark performance tuning and partitioning strategies.
  • Solid SQL expertise with the ability to write and validate complex queries.
  • Experience in data migration or re‑platforming projects.
  • Professional‑level English communication skills.
  • Bachelor’s degree in Computer Science, Information Technology or a related field.

Required skills

  • Databricks
  • PySpark
  • SQL
  • Delta Lake
  • Spark performance tuning
  • Data pipeline development
  • Git
  • CI/CD
  • Agile methodologies
  • Data validation and reconciliation

What we offer

  • End‑of‑service gratuity
  • Private healthcare and life insurance
  • Employee assistance and wellness programs
  • Annual air‑travel allowance for expatriates
  • Regular performance feedback and salary reviews
  • Global travel medical and accident insurance
  • Referral bonuses
  • Learning and development opportunities, including in‑house training and professional certifications

Questions fréquentes

Le salaire n'est pas communiqué publiquement par le recruteur. Vous pouvez postuler et négocier directement avec EPAM Systems.
Cliquez sur "Postuler maintenant" en haut de la page. Vous pouvez importer votre CV en 1 clic — Jobiglo extrait automatiquement vos informations et postule pour vous.

Why are you reporting this job?

Thank you for your report. We will review this job.

Apply in 30 seconds

Enter your email to apply. An account will be created automatically.

By continuing, you accept our terms of use.

Already have an account? Login

💬 Chat with us on Telegram Chat on WhatsApp

Published 1 week ago

Expires 1 month from now

30 views · 0 interested

Boost your chances

Upload your CV — we will match you with relevant openings.

Analyzing your CV...

EPAM Systems

Abou Dabi