Cloudera Data Engineer

About the role

Midis Group is looking for an experienced Cloudera Data Engineer in Dubai. The role centres on building and maintaining big data pipelines, optimising data workflows and supporting production environments so they remain reliable and performant.

Key responsibilities

• Design, build and maintain big data pipelines using Cloudera CDP components.
• Develop and optimise ETL/ELT workflows using Spark, Hive and the Hadoop ecosystem.
• Manage and maintain HDFS storage, ensuring high availability and performance.
• Handle production support, including issue resolution, monitoring and performance tuning.
• Work with data scientists, analysts and other engineering teams on data-driven initiatives.
• Ensure data governance, security and compliance across big data environments.
• Troubleshoot cluster-level issues related to resource utilisation, scheduling and configuration.
• Take part in solution design, architecture discussions and technical documentation.

Required profile

• Bachelor's degree in Computer Science or a related field.
• Strong hands-on experience with Cloudera CDP and the Hadoop ecosystem (HDFS, YARN, MapReduce, Hive, Impala).
• Solid understanding of distributed systems and big data architecture.
• Experience with production support and troubleshooting in big data environments.
• Experience with cloud platforms (AWS, Azure, GCP) for big data workloads; exposure to Kafka, NiFi, Oozie or similar orchestration tools; knowledge of Docker, Kubernetes or containerised environments.

Required skills

• Apache Spark (PySpark or Scala preferred)
• Strong SQL and query optimisation on large datasets
• Familiarity with Linux, shell scripting and automation tools
• Version control (Git) and CI/CD workflows are a plus