Senior Big Data Engineer

About the role

Teamware Human Resource Solutions LLC is seeking an experienced Senior Data Engineer to design, develop and maintain large‑scale data pipelines and real‑time streaming solutions for a leading digital infrastructure and technology company in Dubai.

Key responsibilities

• Design, develop and maintain scalable ETL/ELT pipelines for batch and real‑time processing.
• Build and manage streaming pipelines using Apache Kafka, Spark Streaming and/or Flink.
• Develop data ingestion frameworks with Apache NiFi and automate workflows with Airflow and Oozie.
• Deploy and manage data applications on OpenShift/Kubernetes and implement CI/CD pipelines.
• Drive data migration and integration across on‑premise and cloud environments while ensuring data quality, governance and security.

Required profile

• 8–15 years of hands‑on experience in data engineering and big data technologies.
• Bachelor’s degree in Computer Science, Engineering, IT or related field, or equivalent professional experience.
• Strong technical leadership and stakeholder management capabilities.

Required skills

• Hadoop/Cloudera, Apache Spark & Spark Streaming, Apache Kafka, Flink
• Airflow, Oozie, Apache NiFi
• Hive, HBase
• AWS, Azure, GCP
• OpenShift, Kubernetes
• Data migration, data integration, data quality, governance, security