Senior Data Engineer
EPAM Systems · Abou Dabi
Job description
About the role
We are seeking a Senior Data Engineer to join our Abu Dhabi team on-site. You will lead the migration of a large‑scale data platform to modern technologies, building production‑ready pipelines in a fast‑moving delivery environment.
Key responsibilities
- Design, build, optimise and productionise data pipelines on Databricks using PySpark and SQL.
- Re‑engineer and migrate transformation logic from a legacy platform to Databricks.
- Design and execute data validation and reconciliation processes to ensure cross‑platform accuracy.
- Tune performance through partitioning, Delta optimisation, cluster configuration and ingestion strategies.
- Contribute to medallion‑layer design and implement data‑quality frameworks.
- Review code, mentor junior engineers and promote best practices.
- Work within Git‑based CI/CD pipelines and follow Agile delivery processes.
Required profile
- 7+ years of hands‑on data engineering experience.
- Strong proficiency with Databricks, PySpark, SQL and Delta Lake.
- In‑depth knowledge of ingestion patterns, Spark performance tuning and partitioning strategies.
- Solid SQL expertise with the ability to write and validate complex queries.
- Experience in data migration or re‑platforming projects.
- Professional‑level English communication skills.
- Bachelor’s degree in Computer Science, Information Technology or a related field.
Required skills
- Databricks
- PySpark
- SQL
- Delta Lake
- Spark performance tuning
- Data pipeline development
- Git
- CI/CD
- Agile methodologies
- Data validation and reconciliation
What we offer
- End‑of‑service gratuity
- Private healthcare and life insurance
- Employee assistance and wellness programs
- Annual air‑travel allowance for expatriates
- Regular performance feedback and salary reviews
- Global travel medical and accident insurance
- Referral bonuses
- Learning and development opportunities, including in‑house training and professional certifications
Questions fréquentes
Why are you reporting this job?
Explore further
Salaries, guides and searches in the United Arab Emirates.
Salaries by job title
Apply in 30 seconds
Enter your email to apply. An account will be created automatically.
By continuing, you accept our terms of use.
Already have an account? Login
A question about this job?
Ask it here: you will get the full job summary by e-mail, right away.
Published 1 month ago
Expires 1 week from now
49 views · 0 interested
Boost your chances
Upload your CV — we will match you with relevant openings.
Analyzing your CV...
EPAM Systems
Abou Dabi
Related job offers
-
Software Quality Assurance Lead - Test Automation, Performance & AI-Assisted Testing
ICAN Abou Dabi -
AI and Advanced Data Analysis Specialist
Reneco International Wildlife Consultants LTD Abou Dabi -
Software Engineer - Digital Payments (Resilience)
TAT IT Technolgies Abou Dabi -
ERP Supply Chain Senior Manager (Oracle Fusion)
Miral Experiences LLC -
Lead Data Scientist - Computer Vision
EPAM Abu Dhabi