About Turing:
Based in San Francisco, California, Turing is the world’s leading research accelerator for frontier AI labs and a trusted partner for global enterprises deploying advanced AI systems. Turing supports customers in two ways: first, by accelerating frontier research with high-quality data, advanced training pipelines, plus top AI researchers who specialize in coding, reasoning, STEM, multilinguality, multimodality, and agents; and second, by applying that expertise to help enterprises transform AI from proof of concept into proprietary intelligence with systems that perform reliably, deliver measurable impact, and drive lasting results on the P&L.
Role Overview:
We are seeking a highly qualified Video Games Domain Reviewer to support the quality assurance of Large Language Model (LLM) evaluation projects. In this role, you will review domain-specific prompts, evaluate completed tasks for accuracy and quality, ensure adherence to project guidelines, and provide actionable feedback to maintain high annotation standards. Your expertise in the video games domain will help ensure the reliability and consistency of AI evaluation data.
Key Responsibilities
- Review and validate domain-specific prompts related to game development, esports, gaming platforms, game design, publishers, genres, and gaming communities.
- Evaluate completed tasks to ensure factual accuracy, reasoning quality, completeness, and compliance with project guidelines.
- Identify factual inaccuracies, logical inconsistencies, hallucinations, and low-quality annotations.
- Ensure prompts are challenging, relevant, and aligned with project objectives.
- Provide clear, constructive, and evidence-based feedback to contributors for quality improvement.
- Maintain consistency across reviews by following established quality standards and review rubrics.
- Escalate ambiguous or complex cases when required and document review findings.
- Collaborate with project managers and AI teams to continuously improve evaluation quality and workflows.
Minimum Qualifications
- Master's degree or higher in a discipline related to Video Games, Game Design, Interactive Media, Computer Science, or a closely related field.
- Minimum 3 years of professional, research, teaching, or industry experience in the video games domain.
- Prior experience reviewing, evaluating, editing, or quality-checking technical or domain-specific content is preferred.
- Excellent written English communication and analytical skills.
- Strong attention to detail with the ability to identify subtle factual and logical issues.
Preferred Qualifications
- Experience reviewing AI-generated content, LLM evaluations, prompt engineering, or annotation quality.
- Familiarity with quality assurance processes, peer review, or content moderation.
- Strong understanding of current gaming trends, esports, major publishers, gaming platforms, and game development concepts.
- Ability to provide objective, evidence-based feedback while maintaining consistent quality standards.
- Experience working independently in a fast-paced, quality-focused environment.
Offer Details:
- Commitments Required: 40 hours per week with at least 4 hours PST overlap
- Employment type : Contractor assignment (no medical/paid leave)
- Duration of contract : 8 weeks.