Project Manager – Applied AI

About the role

LILT AI is seeking a data‑driven Project Manager to lead large‑scale multilingual data collection and Large Language Model (LLM) evaluation initiatives. You will act as the operational backbone of AI development, coordinating global annotator teams and ensuring high‑quality, high‑throughput data pipelines.

Key responsibilities

• Manage end‑to‑end lifecycle of AI data projects, from scoping and guideline creation to delivery and post‑mortem analysis.
• Oversee multilingual data pipelines (audio, text, image) and LLM evaluation processes (RLHF, SFT, ranking, safety testing).
• Track and report KPIs such as throughput, quality (accuracy, IAA), and productivity (cost‑per‑task, worker efficiency).
• Run quality‑control loops, perform root‑cause analysis, and implement corrective training for annotators.
• Maintain real‑time dashboards to visualize project health and flag bottlenecks.
• Coordinate with global data experts, crowd pools, and Applied AI Technical Ops teams to meet SLAs and linguistic accuracy.
• Translate technical requirements into clear, actionable guidelines for non‑technical annotators and facilitate feedback loops for continuous improvement.

Required profile

• 3‑5+ years of project management experience in AI/ML data operations.
• Strong understanding of LLM training (pre‑training, SFT, RLHF) and evaluation methodologies.
• Proven ability to work with Agile, Scrum, or Kanban frameworks.
• Excellent written communication for multilingual audiences.

Required skills

• Advanced proficiency in Excel and Google Sheets.
• Ability to write SQL queries for performance data extraction and analysis.
• Experience with Agile, Scrum, and Kanban project‑management methodologies.