PySpark Data Engineer

About the role

We are looking for an experienced PySpark Data Engineer to join our Dubai team at Virtusa. The role focuses on building and maintaining large‑scale data pipelines that support banking and financial services operations.

Key responsibilities

• Design, develop, and maintain scalable data pipelines using PySpark for processing large volumes of structured and unstructured data.
• Develop and manage ETL/ELT workflows with Informatica BDM.
• Collaborate with data architects, analysts, and business stakeholders to translate data requirements into technical solutions.
• Optimize data processing jobs for performance and reliability.
• Implement data quality, governance, and validation processes.
• Integrate data from databases, APIs, and enterprise systems.
• Support data warehouse and data lake initiatives.
• Ensure compliance with banking regulatory and security standards.
• Troubleshoot pipeline issues and performance bottlenecks.
• Participate in code reviews, testing, and deployment to maintain high development standards.

Required profile

• Minimum 6 years of experience in data engineering or related roles.
• Proven experience with PySpark on large‑scale data processing.
• Strong hands‑on experience with Informatica BDM.
• Experience with big‑data technologies and distributed processing frameworks.
• Solid knowledge of SQL and data modeling.
• Background in banking or financial services, preferably with enterprise data platforms and regulatory reporting.
• Strong analytical, problem‑solving and communication abilities.

Required skills

• PySpark
• Informatica BDM
• SQL
• Hadoop
• Spark
• Python