Remote Quality Analyst – AI Personalization

About the role

We are looking for a Remote Quality Analyst to join a leading technology company and help evaluate a new personalization feature for an AI model. You will use your own experiences as context to test how well the model integrates data from conversations, email, search and activity to produce relevant responses.

Key responsibilities

• Assess the quality of personalized AI responses using personal data sources.
• Design multi‑turn prompts that challenge the model’s ability to merge personal information accurately.
• Evaluate model outputs for grounding, relevance, helpfulness and correct personalization.
• Compare side‑by‑side AI responses to spot subtle differences in accuracy.
• Provide detailed feedback to improve the model’s personalization performance.

Required profile

• Fluent English with strong reading and writing skills.
• Experience in prompt engineering or creating test cases for AI models.
• Analytical mindset capable of dissecting nuanced AI outputs.
• Attention to detail to detect subtle discrepancies.
• Willingness to use a personal Google account and enable data sources for testing.

Required skills

• Prompt engineering
• Designing test cases for AI models
• Evaluation metrics in AI systems
• Familiarity with personalization concepts

What we offer

• Competitive compensation based on experience.
• Full‑time remote work with flexible hours.
• Opportunity to influence cutting‑edge AI personalization technology.