Research Quality Specialist

About Turing:

Based in San Francisco, California, Turing is the world’s leading research accelerator for frontier AI labs and a trusted partner for global enterprises deploying advanced AI systems. Turing supports customers in two ways: first, by accelerating frontier research with high-quality data, advanced training pipelines, plus top AI researchers who specialize in coding, reasoning, STEM, multilinguality, multimodality, and agents; and second, by applying that expertise to help enterprises transform AI from proof of concept into proprietary intelligence with systems that perform reliably, deliver measurable impact, and drive lasting results on the P&L.

Role Overview
We are looking for a detail-oriented reviewer to evaluate research prompts and rubric criteria to ensure accuracy, consistency, and overall quality. This role requires strong analytical thinking and the ability to identify issues and refine evaluation standards within a structured quality framework.

Key Responsibilities

• Review research prompts and rubric criteria for accuracy, consistency, and quality using a structured quality framework.
• Identify issues such as duplicate criteria, vague evaluation standards, and misaligned scoring weights.
• Rewrite or refine flagged items with clear and well-documented reasoning for downstream reviewers.
• Complete structured review forms at each stage of a sequential expert review pipeline.
• Participate in calibration rounds to align on quality standards before batch delivery.

Preferred Skills

• Strong attention to detail and analytical reasoning.
• Ability to evaluate and improve structured evaluation frameworks.
• Experience reviewing prompts, guidelines, or evaluation rubrics is a plus.

Benefits:

• Competitive compensation based on experience and expertise.
• Flexible working hours and remote work environment.
• Opportunity to work on cutting-edge AI projects with leading LLM companies.
• Potential for contract extension based on performance and project needs.

Perks of Freelancing with Turing:

• Work on the cutting edge of AI.
• Fully remote and flexible work environment.
• Exposure to advanced LLMs and insight into how they’re trained.

Offer Details:

• Commitments Required: 40 hours per week with 4 hours of overlap with PST.
• Engagement type: Contractor assignment/freelancer (no medical/paid leave)
• Duration: 1 month.

Application Process:

• Shortlisted candidates will be sent an automated challenge (60 mins).
• Once you clear the challenge, we will reach out to you for an interview.
• Once you clear the interview, you are ready to go!