LLM Annotator

About Turing:

Turing is one of the world’s fastest-growing AI companies, accelerating the advancement and deployment of powerful AI systems.

Turing helps customers in two ways: Working with the world’s leading AI labs to advance frontier model capabilities in thinking, reasoning, coding, agentic behavior, multimodality, multilinguality, STEM, and frontier knowledge; and leveraging that work to build real-world AI systems that solve mission-critical priorities for companies.

Role Overview:

We are seeking highly motivated LLM Annotators to support the evaluation and improvement of cutting-edge Large Language Models (LLMs). In this role, you will analyze structured data, create challenging prompts, evaluate AI-generated responses for factual accuracy and reasoning quality, and provide evidence-backed feedback to improve model performance.

Key Responsibilities

• Create challenging prompts that evaluate an LLM's ability to retrieve, analyze, and reason over structured data.
• Assess AI-generated responses for factual accuracy, logical reasoning, and completeness.
• Identify model failures, inconsistencies, hallucinations, and reasoning gaps.
• Validate model outputs using provided datasets and supporting evidence.
• Document findings with clear, evidence-based explanations.
• Consistently follow annotation guidelines and maintain high-quality standards.

Required Qualifications

• Master's degree or higher in any discipline.
• Minimum 3 years of professional, research, or teaching experience.
• Strong analytical and critical thinking skills.
• Excellent written English communication skills.
• Exceptional attention to detail and ability to validate information against source data.

Perks of Freelancing with Turing:

• Work on the cutting edge of AI.
• Fully remote and flexible work environment.
• Exposure to advanced LLMs and insight into how they’re trained.

Offer Details:

• Commitments Required : At least 4 hours per day and minimum 20 hours per week with 4 hours of overlap with PST. (We have 3 options of time commitment: 20 hrs/week, 30 hrs/week or 40 hrs/week)
• Engagement type  : Contractor assignment/freelancer (no medical/paid leave)
• Duration: 1 month.

Evaluation Process:

• Shortlisting based on qualifications and relevant professional writing work experience.
• Shortlisted candidates will be sent an  analytical challenge (approximately 45 minutes) and a writing assessment (approximately 30 minutes).