Computer Science - Domain experts

About Turing
Based in San Francisco, California, Turing is the world’s leading research accelerator for frontier AI labs and a trusted partner for global enterprises deploying advanced AI systems. Turing supports customers in two ways: first, by accelerating frontier research with high-quality data, advanced training pipelines, plus top AI researchers who specialize in coding, reasoning, STEM, multilinguality, multimodality, and agents; and second, by applying that expertise to help enterprises transform AI from proof of concept into proprietary intelligence with systems that perform reliably, deliver measurable impact, and drive lasting results on the P&L.

Job Overview

We are looking for PhD level computer science experts to help fine-tune and evaluate large language models, including systems similar to ChatGPT. The role focuses on designing challenging, conceptual computer science problems that test advanced AI reasoning across topics such as algorithms, systems design, cybersecurity, theory, databases, networks, and other undergraduate to PhD-level computer science domains.

Key Responsibilities

• Design advanced computer science problems that test AI model performance across conceptual and reasoning-heavy topics, including systems design, algorithms, cybersecurity, and other advanced CS areas.
• Develop clear, step-by-step reference solutions with rigorous logic, well-structured explanations, and defensible reasoning.
• Evaluate AI-generated responses for correctness, reasoning quality, completeness, clarity, and alignment with the intended problem requirements.
• Identify flaws, gaps, edge cases, and near-miss reasoning patterns in AI outputs.
• Collaborate with researchers to refine benchmarks across undergraduate, graduate, and PhD-level computer science topics.
• Provide structured feedback to improve problem quality, benchmark reliability, and model evaluation standards.

Required Qualifications

• PhD, completed or pursuing, in Computer Science or a closely related field.
• Strong computer science reasoning and problem-solving skills across advanced domains.
• Ability to design challenging conceptual problems that require deep understanding rather than straightforward recall or coding.
• Excellent written communication skills, with the ability to explain complex technical ideas clearly and logically.
• Strong attention to detail in evaluating reasoning, assumptions, definitions, edge cases, and solution validity.
• Ability to provide structured, high-quality feedback on AI-generated responses.
• No prior AI experience required.

Offer Details

• Commitments Required: at least 4 hours per day and up to 40 hours per week with 4 hours of overlap with PST.
• Engagement type: Contractor

Evaluation Process

• Shortlisted candidates will be sent a Job Interest Form.
• After the profile review, an assessment will be shared, which must be completed within 24 hours.
• Based on the assessment outcomes, shortlisted candidates will be contacted to schedule an interview.