LLM Trainer: Reasoning Specialist

Job Summary: We are seeking enthusiastic and imaginative trainers to develop creative and engaging prompts across diverse categories to evaluate LLM models. Trainers will generate prompts in accordance with our detailed taxonomy and ensure prompts accurately reflect their intended use cases.

Key Responsibilities:

• Generate high-quality, imaginative prompts based on a provided taxonomy for evaluating LLM models.
• Cover diverse creative writing categories including storytelling, gaming, humor, anime, roleplay, and cultural discussions.
• Ensure consistency, creativity, and appropriateness of prompts for robust LLM evaluation.
• Collaborate closely with the evaluation team to refine prompts based on model response quality and user engagement.

Required Qualifications:

• Excellent command of English (written and verbal).
• Strong creativity, storytelling skills, and cultural knowledge across various entertainment and narrative genres.
• Familiarity with gaming, anime, pop culture, literature, and internet culture.
• Ability to craft engaging content suitable for diverse audiences.
• Bachelors degree or higher in Creative Writing, English, Literature, Education, Linguistics, Social Science, Culture Studies, Media Studies, Film Studies, Translation, or a related field.
• Strong knowledge/interest in more than one of the following areas:
  • Storytelling, script-writing, poetry, and songwriting
  • Fanfiction writing, roleplaying, or creating satirical and comedic content
  • Familiarity with pop culture, fandoms, anime, or other subcultures
  • Intermediate proficiency in English.

Preferred Qualifications:

• Prior experience with prompt creation or working with AI/LLMs.
• Educational or professional background in creative writing, literature, game design, or related fields.
• Deep understanding of various writing styles (e.g., copywriting, creative non-fiction), as well as genres (e.g., historical fiction and fantasy).
• Ability to evaluate narrative quality, character development, emotional depth, and dialogue nuance.
• Experience in editing, proofreading, and improving written work for clarity, style, and tone.
• Experience in data annotation or related fields, especially with large language models or AI evaluation processes.
• Multilingual speaker with the ability to speak one other language preferred (including Chinese, Korean, Japanese, Arabic, Vietnamese, Russian, etc.)
• Passion for writing, exceptional creativity, and the ability to blend artistry with technical writing skills