Content Quality and Evaluation Specialist - AI Data Service Operations

Written by the T&S Network from TikTok's posting.

Sets quality standards and judgment rules for multilingual, multimodal data used both in TikTok's content governance and in training and evaluating AI and large language models. The AI Data Service and Operations team produces the datasets across safety and non-safety domains, and this role acts as the gatekeeper for their accuracy and consistency.

• AI misuse and jailbreaks

What you'd do

• Review and adjudicate data outputs against standards, flag issues, and close the loop on corrections.
• Take on hard, unclear, and edge cases, then convert the outcomes into reusable judgment rules and knowledge assets.
• Track quality metrics, find root causes, and drive improvements in production processes.

What it asks for

• Excellent English, with IELTS 7.5 or TOEFL 105 or equivalent.
• Skill in applying complex guidelines or policies to written review work.
• Proficiency in Excel and common data tools.
• Hands-on use of mainstream LLM products and a basic understanding of AI capability limits (preferred).

Our best summary of the posting, and it can be wrong. The employer's posting is what counts: read it in full on TikToknorth_east before you apply. If we got something wrong, report this listing.