About Turing:
Turing is one of the world’s fastest-growing AI companies accelerating the advancement and deployment of powerful AI systems.
Turing helps customers in two ways: Working with the world’s leading AI labs to advance frontier model capabilities in thinking, reasoning, coding, agentic behavior, multimodality, multilinguality, STEM and frontier knowledge; and leveraging that work to build real-world AI systems that solve mission-critical priorities for companies.
Role Overview:
We are building a highly accurate, evaluation-grade dataset of transcribed, multi-channel audio recordings to assess multilingual, multi-speaker AI systems. This project involves evaluating high-quality and realistic conversations representing diverse dynamics, contexts, and demographics.
What does day-to-day look like:
- Review and evaluate AI-generated transcriptions and diarization outputs to ensure exceptionally high accuracy and adherence to strict low error-rate (WER) targets.
- Validate whether transcripts correctly capture spontaneous, unnormalized speech while preserving natural conversational dynamics such as overlaps, interruptions, false starts, and disfluencies.
- Assess the precision of turn-level and word-level timestamps, as well as speaker identification, paying special attention to complex, overlapping dialogue.
- Comfortably read and validate underlying JSON-formatted outputs to ensure accurate metadata tagging, diarization alignment, and timestamp logic.
- Identify transcription, diarization, segmentation, and alignment errors and determine whether AI output quality meets acceptance thresholds.
Requirements:
- Fluent/Native proficiency in Portuguese (Brazil).
- Exceptional ear for audio fidelity and the ability to detect subtle background noises, channel bleed, or clipping.
- Meticulous attention to detail for verifying word-level timestamps, diarization accuracy, and strict, unnormalized verbatim transcription rules.
- Ability to evaluate AI-generated transcription quality and identify recognition, segmentation, and speaker attribution errors.
Preferred Qualifications:
- Linguists / Phonetics Experts: Deep understanding of natural, unnormalized speech patterns. Expertise in evaluating conversational dynamics and identifying transcription and diarization inconsistencies in spontaneous speech.
- Language Teachers: Exceptional, native-level mastery of the target language. Ability to evaluate transcript fidelity and ensure speech content is preserved without normalization or grammar correction.
- Professional Transcriptionists / Speech Data QA Specialists: Strong ear for audio fidelity, rigorous timestamp validation skills, experience reviewing ASR outputs, and ability to assess transcription quality against strict accuracy targets. Experience validating turn-level and word-level timestamps is highly preferred.
Perks of Freelancing With Turing:
- Work in a fully remote environment.
- Opportunity to work on cutting-edge AI projects with leading LLM companies.
- Potential for contract extension based on performance and project needs.
Offer Details:
- This is a flexible agreement, not a full-time or part-time employment position.
Evaluation Process
- Shortlisting based on qualifications and relevant professional experience.
- Shortlisted candidates will undergo a delivery review, after which they will be ready to start!