Content Quality and Evaluation Specialist Graduate (Portuguese - SMO) - 2027 Start

Written by the T&S Network from TikTok's posting.

Sets quality standards and judgment rules for multilingual, multimodal data used in TikTok's content governance and in training and evaluating AI and large language models. The AI Data Service & Operations team covers both safety and non-safety domains across TikTok's international products, and the role acts as the quality gate for that data.

What you'd do

• Shape quality benchmarks, judgment guidance, and pass criteria used for LLM training and evaluation work.
• Check data outputs against those standards, flag problems, and follow fixes through to completion.
• Work through hard, unclear, and borderline cases and convert the outcomes into rules the team can reuse.
• Track quality numbers, find root causes, and push fixes into production workflows.

What it asks for

• Excellent English across listening, speaking, reading, and writing, with IELTS 7.5 or TOEFL 105 or equivalent.
• Proficient in Excel and common data tools.
• Skill in applying detailed guidelines or policies to written work.
• Hands-on use of mainstream LLM products and a basic grasp of AI capability limits (preferred).
• Experience assessing qualitative material or using data to improve processes; internships and projects count.

Worth knowing

• Graduate role requiring an onboarding date by the end of the year.

Our best summary of the posting, and it can be wrong. The employer's posting is what counts: read it in full on TikToknorth_east before you apply. If we got something wrong, report this listing.