AI Quality Engineer

About the role

RAKBANK is looking for an experienced AI Quality Engineer to lead quality engineering and testing across its AI, Generative AI, Conversational AI, Agentic AI and Intelligent Automation initiatives. This hands‑on position ensures AI‑powered solutions are accurate, reliable, secure, explainable and ready for production within the bank’s digital ecosystem.

Key responsibilities

• Define and execute end‑to‑end quality engineering strategies for Generative AI, Conversational AI, Agentic AI and intelligent automation solutions.
• Design AI testing frameworks covering RAG evaluation, hallucination detection, safety testing, prompt validation and model regression.
• Benchmark Large Language Models for accuracy, latency, groundedness, safety and cost.
• Build automated testing suites using Python, PyTest, Playwright, API automation and integrate them into CI/CD pipelines.
• Collaborate with product, engineering and data‑science teams to embed quality gates throughout the AI development lifecycle.
• Mentor QA and automation teams and ensure compliance with banking regulations and UAE data‑privacy laws.

Required profile

• Bachelor’s degree with 8‑10 years of testing experience, including at least 3 years in banking technology projects.
• Strong expertise in Generative AI, Conversational AI, Agentic AI testing and LLM evaluation.
• Hands‑on experience with Python, PyTest, Playwright, API automation and UiPath Test Suite.
• Proven ability to integrate automated testing into Azure DevOps, Jenkins or GitLab pipelines.
• Knowledge of AI safety testing, prompt injection, hallucination detection and relevant banking regulations.

Required skills

• Python
• PyTest
• Playwright
• API automation
• UiPath Test Suite
• Azure DevOps
• Jenkins
• GitLab
• CI/CD pipelines