📢 New: get today's jobs on our WhatsApp Channel
Jobiglo

No results.

This job is no longer available

This job expired on 15/11/2026. It no longer accepts applications.

AI Assurance Quality Engineer

Cognizant · Dubai

🇬🇧 English
Python test automation Prompt Engineering Context Management Function/Tool Calling Retrieval Mechanisms Rubric-Based Assessment LLM-as-a-Judge frameworks Human Review Workflows Statistical Quality Metrics Amadeus Altéa Sabre Navitaire

Job description

About the role

Cognizant is seeking an AI Assurance Quality Engineer to lead the testing and validation of AI‑driven conversational solutions. You will work on chatbots, virtual assistants, Retrieval‑Augmented Generation (RAG) applications, and agentic AI systems, ensuring they meet high standards of reliability, performance, and regulatory compliance.

Key responsibilities

  • Design and implement automated test frameworks for LLM‑based and conversational AI applications.
  • Develop Python scripts to generate, execute, and report test cases across diverse AI solutions.
  • Evaluate non‑deterministic AI outputs using golden datasets, rubric‑based assessments, and LLM‑as‑a‑Judge frameworks.
  • Collaborate with product and domain experts to define AI failure modes, quality risks, and mitigation strategies.
  • Maintain documentation of test results, statistical quality metrics, and continuous improvement recommendations.

Required profile

  • Minimum 4 years of software quality engineering experience.
  • Strong background in airline/travel reservation systems such as Amadeus Altéa, Sabre, or Navitaire.
  • Hands‑on experience with GDS, NDC, IATA fare construction, fare rules, ancillaries, IROPS, payments and refunds.
  • Proven ability to work with non‑deterministic AI models and assess their outputs.

Required skills

  • Python scripting and test‑automation development.
  • Testing of LLM‑based applications, chatbots, virtual assistants, RAG and agentic AI solutions.
  • Prompt engineering, context management, function/tool calling, and retrieval mechanisms.
  • AI failure‑mode analysis, statistical quality metrics, and human‑review workflows.
  • Experience with golden datasets, rubric‑based assessments, and LLM‑as‑a‑Judge frameworks.

Questions fréquentes

Le salaire n'est pas communiqué publiquement par le recruteur. Vous pouvez postuler et négocier directement avec Cognizant.
Cliquez sur "Postuler maintenant" en haut de la page. Vous pouvez importer votre CV en 1 clic — Jobiglo extrait automatiquement vos informations et postule pour vous.

Why are you reporting this job?

Thank you for your report. We will review this job.

A question about this job?

Ask it here: you will get the full job summary by e-mail, right away.

Published 2 months ago

134 views · 0 interested

Boost your chances

Upload your CV — we will match you with relevant openings.

Analyzing your CV...

Cognizant

Dubai