Senior Data Platform Engineer (Cloudera CDP)

About the role

We are seeking an experienced Senior Data Platform Engineer with deep, hands‑on expertise in Cloudera Data Platform (CDP). The role involves both data engineering and platform engineering responsibilities in a large‑scale enterprise Big Data environment.

Key responsibilities

• Design, develop, maintain and support ETL/ELT pipelines using Apache NiFi, Spark/PySpark, Oozie/Airflow.
• Support and manage enterprise CDP production environments, monitor health, availability, performance and capacity.
• Troubleshoot complex platform, infrastructure, application and data issues; handle production incidents, perform RCA and implement permanent fixes.
• Optimize Spark jobs, SQL queries and overall platform performance.
• Support Apache Kafka and real‑time data processing workloads.
• Participate in platform upgrades, patching, maintenance and configuration changes.
• Automate operational activities with Shell scripting and Python; maintain technical documentation and runbooks.

Required profile

• Strong analytical, problem‑solving and debugging abilities.
• Ownership, accountability and proactive attitude.
• Excellent communication and documentation skills.
• Ability to work independently and collaborate with cross‑functional teams.

Required skills

• Cloudera Data Platform (CDP)
• Hadoop ecosystem
• Apache Hive & Impala
• Apache NiFi
• Apache Spark / PySpark
• Apache Kafka
• Apache Iceberg
• Linux & Shell scripting
• SQL
• Python