Content Quality and Evaluation Specialist Graduate (Turkish - SMO) - 2027 Start

Written by the T&S Network from TikTok's posting.

Sets quality standards and judgment rules for multilingual, multimodal data used in TikTok's safety and non-safety content governance and in training and evaluating AI and large language models. The AI Data Service & Operations team runs this work, covering TikTok's international products.

What you'd do

• Shape and refine quality benchmarks, decision rules, and pass criteria for LLM training and evaluation sets.
• Check data outputs against standards, flag problems, and make sure corrections get made and confirmed.
• Resolve murky and boundary-case items, then convert the outcomes into rules and reference material others can reuse.
• Monitor quality numbers, trace the causes of defects, and push fixes into production workflows.
• Coordinate with production, product, algorithm, and policy groups so standards, output, review, and feedback stay connected.

What it asks for

• Excellent English proficiency, IELTS 7.5 or TOEFL 105 or equivalent
• Proficiency in Excel and common data tools
• Hands-on use of mainstream LLM products and a basic understanding of AI capability limits (preferred)
• Experience turning complex guidelines or policies into consistent decisions through written work
• Some experience assessing qualitative material or using data to improve processes

Worth knowing

• Graduate role with a start date by the end of the year

Our best summary of the posting, and it can be wrong. The employer's posting is what counts: read it in full on TikToknorth_east before you apply. If we got something wrong, report this listing.