Data Engineer

About the role

Inception42, a G42 company and leading AI innovator in the UAE, is seeking a Data Engineer to design and operate scalable data pipelines while developing intelligent AI solutions. The role focuses on leveraging Azure Agent Foundry, OpenAI services, LangChain, Databricks and modern cloud architectures to deliver enterprise‑grade AI applications.

Key responsibilities

• Develop and deploy AI agents using Azure Agent Foundry, OpenAI, LangChain and N8N.
• Build Retrieval‑Augmented Generation (RAG) pipelines, embeddings, vector‑database integrations and knowledge‑graph solutions.
• Design, implement and maintain scalable ETL/ELT workflows and data architectures on Azure.
• Create and manage APIs and data services that support AI and analytics workloads.
• Optimize machine‑learning workflows on Azure Databricks and integrate with Azure Fabric.
• Ensure data quality, governance and compliance across all platforms.
• Collaborate with data scientists, ML engineers and product teams to deliver intelligent features.
• Support MLOps and DevOps processes, including CI/CD, model lifecycle management and containerised deployments.

Required profile

• Bachelor’s degree in Computer Science, Engineering, Data Science or a related field.
• Minimum 3 years of experience in data engineering, AI engineering or ML engineering.
• Proven experience delivering scalable AI/data solutions in cloud environments, preferably Azure.
• Strong problem‑solving abilities and effective cross‑functional communication.

Required skills

• Python, SQL, PySpark.
• Azure Agent Foundry, OpenAI APIs, LangChain, N8N.
• Azure Databricks, Azure Fabric, Azure cloud services.
• Big‑data technologies such as Spark, Hadoop, Flink.
• Data storage solutions: SQL, NoSQL, vector databases.
• API development: REST, GraphQL.
• Messaging systems: Kafka, RabbitMQ.
• Containerisation and orchestration: Docker, Kubernetes.
• CI/CD pipelines, MLOps, model lifecycle management.

What we offer

• Open, diverse and inclusive culture with a global vision.
• Extensive learning, development and growth opportunities through structured training and high‑tech projects.
• Competitive remuneration package including healthcare, education support and generous leave benefits.