AI Assurance Quality Engineer
Cognizant · Doubaï
Job description
About the role
We are seeking an experienced AI Assurance Quality Engineer to ensure the quality, reliability, and performance of AI‑powered conversational systems such as chatbots, virtual assistants, RAG applications, and agentic AI solutions.
Key responsibilities
- Design, develop, and maintain automated test frameworks and tools using Python.
- Test and evaluate LLM‑based applications, conversational AI systems, and retrieval‑augmented generation solutions.
- Assess non‑deterministic AI outputs with golden datasets, rubric‑based assessments, and statistical quality metrics.
Required profile
- 4+ years of software quality engineering experience.
- Strong understanding of prompt engineering, context management, function/tool calling, and AI failure modes.
- Domain expertise in airline/travel reservation systems (e.g., Amadeus Altéa, Sabre, Navitaire).
Required skills
- Python scripting and test automation framework development.
- Hands‑on testing of LLM‑based conversational AI applications.
- Experience with evaluation methods such as LLM‑as‑a‑Judge, human review workflows, and statistical quality metrics.
Questions fréquentes
Why are you reporting this job?
Explore further
Salaries, guides and searches in the United Arab Emirates.
Salaries by job title
Apply in 30 seconds
Enter your email to apply. An account will be created automatically.
By continuing, you accept our terms of use.
Already have an account? Login
A question about this job?
Ask it here: you will get the full job summary by e-mail, right away.
Boost your chances
Upload your CV — we will match you with relevant openings.
Analyzing your CV...
Cognizant
Doubaï
Related job offers
-
Head of Information Technology
EATX Doubaï -
Java Architect - Airlines, Airports & Travel Technology
Atain Doubaï -
Chief Specialist - AI Solutions Quality Assurance (Model Validation)
Roads and Transport Authority Doubaï -
VP - Data Analytics
Systems Limited Pendjab -
Service Excellence Associate Principal
Fisher HR Dubai