PySpark Data Engineer

About the role

We are looking for a highly skilled Data Engineer with more than six years of experience to design, build and optimise data pipelines for a banking environment. The role focuses on large‑scale processing using PySpark and Informatica BDM.

Key responsibilities

• Design, develop and maintain scalable PySpark pipelines for structured and unstructured data.
• Develop and manage ETL/ELT workflows with Informatica BDM.
• Collaborate with data architects, analysts and business stakeholders to translate requirements into technical solutions.
• Optimise job performance, implement data quality, governance and validation processes.
• Integrate data from databases, APIs and enterprise systems and support data‑lake and data‑warehouse initiatives.
• Ensure compliance with banking regulatory and security standards, troubleshoot pipeline issues and participate in code reviews and deployments.

Required profile

• 6+ years of experience in data engineering or related roles.
• Mandatory experience in the banking or financial services domain.
• Proven ability to work with large‑scale data platforms and distributed processing frameworks.

Required skills

• Strong hands‑on experience with PySpark.
• Informatica BDM (Big Data Management) expertise.
• Solid SQL and data‑modeling knowledge.
• Experience with Hadoop/Spark ecosystems and big‑data technologies.
• Familiarity with cloud platforms or big‑data ecosystems (optional).
• Understanding of data governance, security and banking compliance requirements.