AI Evaluation Specialist – Remote Contractor

About the role

We are looking for an AI Evaluation Specialist to help train next‑generation AI systems. Working remotely, you will assess AI‑generated outputs and provide high‑quality feedback that directly influences model performance.

Key responsibilities

• Review AI‑generated content for quality, clarity, usability and overall user experience.
• Identify inconsistencies, weaknesses and improvement opportunities across diverse content types.
• Apply structured evaluation guidelines and deliver nuanced feedback to inform model refinements.
• Collaborate with cross‑functional teams to define quality standards, scoring criteria and review processes.
• Maintain high accuracy and consistency across evaluations to ensure reliable results.
• Contribute to the continuous improvement of evaluation workflows and best practices.

Required profile

• Exceptional reading comprehension and acute attention to detail.
• Strong observational skills with excellent aesthetic or editorial judgment.
• Ability to think critically and deliver consistent, high‑quality evaluations in ambiguous scenarios.
• Excellent written and verbal communication skills.
• Comfort working across various content types and evaluation guidelines.
• Strong sense of ownership, reliability and commitment to delivering high‑quality work.
• Open‑minded approach to learning and quickly adapting to new workflows.

Required skills