Data Engineer

About the role

Inception42, a G42 company, is seeking a Data Engineer to build scalable data pipelines and develop AI solutions using Azure Agent Foundry, OpenAI services, LangChain, Databricks and modern cloud architectures. The role sits within the core intelligence layer, transforming data and compute infrastructure into applied AI solutions for various domains.

Key responsibilities

• Develop and deploy AI agents with Azure Agent Foundry, OpenAI, LangChain and N8N.
• Build Retrieval‑Augmented Generation (RAG) pipelines, embeddings, vector database integrations and knowledge graph solutions.
• Design, implement and maintain scalable ETL/ELT data pipelines and data architectures.
• Create and manage APIs and data services supporting AI and analytics workloads.
• Optimize machine‑learning workflows on Azure Databricks and integrate with Azure Fabric.

Required profile

• Bachelor’s degree in Computer Science, Engineering, Data Science or related field.
• 3+ years of experience in data, AI or ML engineering roles.
• Proven experience delivering scalable AI/data solutions in Azure cloud environments.
• Strong problem‑solving, communication and cross‑functional collaboration skills.

Required skills

• Python, SQL, PySpark.
• Azure Agent Foundry, OpenAI APIs, LangChain, N8N.
• Azure Databricks, Azure Fabric, Azure cloud services.
• Big‑data tools: Spark, Hadoop, Flink.
• Data storage: SQL, NoSQL, vector databases.
• API technologies: REST, GraphQL.
• Messaging: Kafka, RabbitMQ.
• Containerisation: Docker, Kubernetes.

What we offer

• Open, diverse and inclusive culture with a global vision.
• Learning, development and growth opportunities through structured training and high‑tech projects.
• Competitive remuneration package with healthcare, education support and leave benefits.