Content Quality and Evaluation Specialist Graduate (SMO) - 2027 Start

Written by the T&S Network from TikTok's posting.

Sets and enforces quality standards for multilingual, multimodal data used both in TikTok's content governance and in training and evaluating AI and large language models. The team is the AI Data Service & Operations group behind TikTok's international products, covering safety and non-safety domains. The role acts as the quality gate for AI training and evaluation data.

What you'd do

• Help build and refine the quality benchmarks, decision rules, and pass criteria used for LLM training and evaluation.
• Review and adjudicate data outputs against standards, flag issues, and close the loop on corrections.
• Work through complex, ambiguous, and edge cases and turn conclusions into reusable judgment rules.
• Track quality metrics, find root causes, and drive improvements in production processes.

What it asks for

• Excellent English reading, writing, listening, and speaking, with comprehension of English video and text; IELTS 7.5 or TOEFL 105 or equivalent.
• Skill applying complex guidelines or policies in writing-focused work, with some experience assessing qualitative content.
• Proficiency in Excel and common data tools.
• Hands-on use of mainstream LLM products and a basic understanding of AI capability limits (preferred).
• Background in writing or applying content policy, operational guidelines, or enforcement workflows (preferred).

Worth knowing

• Graduate role with a required onboarding date by the end of the year.

Our best summary of the posting, and it can be wrong. The employer's posting is what counts: read it in full on TikToknorth_east before you apply. If we got something wrong, report this listing.