Senior Data Engineer
EPAM Systems · Abou Dabi
Job description
About the role
We are seeking a Senior Data Engineer to join our Abu Dhabi team on-site. You will lead the migration of a large‑scale data platform to modern technologies, building production‑ready pipelines in a fast‑moving delivery environment.
Key responsibilities
- Design, build, optimise and productionise data pipelines on Databricks using PySpark and SQL.
- Re‑engineer and migrate transformation logic from a legacy platform to Databricks.
- Design and execute data validation and reconciliation processes to ensure cross‑platform accuracy.
- Tune performance through partitioning, Delta optimisation, cluster configuration and ingestion strategies.
- Contribute to medallion‑layer design and implement data‑quality frameworks.
- Review code, mentor junior engineers and promote best practices.
- Work within Git‑based CI/CD pipelines and follow Agile delivery processes.
Required profile
- 7+ years of hands‑on data engineering experience.
- Strong proficiency with Databricks, PySpark, SQL and Delta Lake.
- In‑depth knowledge of ingestion patterns, Spark performance tuning and partitioning strategies.
- Solid SQL expertise with the ability to write and validate complex queries.
- Experience in data migration or re‑platforming projects.
- Professional‑level English communication skills.
- Bachelor’s degree in Computer Science, Information Technology or a related field.
Required skills
- Databricks
- PySpark
- SQL
- Delta Lake
- Spark performance tuning
- Data pipeline development
- Git
- CI/CD
- Agile methodologies
- Data validation and reconciliation
What we offer
- End‑of‑service gratuity
- Private healthcare and life insurance
- Employee assistance and wellness programs
- Annual air‑travel allowance for expatriates
- Regular performance feedback and salary reviews
- Global travel medical and accident insurance
- Referral bonuses
- Learning and development opportunities, including in‑house training and professional certifications
Questions fréquentes
Why are you reporting this job?
Apply in 30 seconds
Enter your email to apply. An account will be created automatically.
By continuing, you accept our terms of use.
Already have an account? Login
Published 1 week ago
Expires 1 month from now
30 views · 0 interested
Boost your chances
Upload your CV — we will match you with relevant openings.
Analyzing your CV...
EPAM Systems
Abou Dabi
Related job offers
-
Senior Engineer - Technology Quality Assurance
Space42 Abou Dabi -
IT Project Manager – Arabic Speaker (Abu Dhabi)
TATWEER MIDDLE EAST AND AFRICA L.L.C Abou Dabi -
Cyber Security Specialist – SOC & Incident Response
NorthBay Solutions Abou Dabi -
Spécialiste IT Santé (HIS) – CDI
Global Med Connect Uae Dubai -
Senior Quality Assurance Engineer - Commercial
Emirates Dubai