Quality Assurance Engineer (AI/GenAI)

About the role

Presight is seeking a passionate Quality Assurance Engineer to lead testing efforts for its Generative AI‑driven products. You will ensure data integrity, compliance, and functional reliability while evaluating AI‑specific features such as large language model responses, retrieval‑augmented generation pipelines, and autonomous AI agents.

Key responsibilities

• Design and execute test plans, test cases, and automation scripts based on product specifications.
• Perform functional, performance, stress, scalability, and security testing for new and existing solutions.
• Assess AI‑powered features for accuracy, relevance, hallucination rate, latency, bias, and safety.
• Define evaluation metrics and golden datasets using frameworks like LangSmith, Ragas, DeepEval, or Promptfoo.
• Leverage AI‑assisted testing tools and coding assistants (e.g., GitHub Copilot, Claude, Cursor) to accelerate test creation and defect triage.
• Implement self‑healing automation to improve coverage and reduce flaky tests.
• Document bugs, maintain change logs, and produce user guides.
• Ensure compliance with QHSE, information security, privacy, and responsible‑AI policies.

Required profile

• Bachelor’s degree in Artificial Intelligence, Computer Science, or a related field.
• Strong understanding of software testing methodologies and AI/ML concepts.
• Experience with generative AI evaluation and responsible‑AI considerations.

Required skills

• LangSmith, Ragas, DeepEval, Promptfoo
• GitHub Copilot, Claude, Cursor
• AI‑assisted testing tools
• Test automation, stress testing, performance testing, functional testing, scalability testing