Safeguards Enforcement Lead, User Well-Being

Written by the T&S Network from Anthropic's posting.

Manages the enforcement workflows for child safety, mental health, abuse and exploitation, and age assurance harms on a user well-being team, including the team that scales and maintains the detection and response systems. Works as the central point of contact for content review partners and coordinates with Engineering, Policy, and Legal to close enforcement gaps.

• Child sexual abuse material
• Child safety and grooming
• Adult and sexual content

What you'd do

• Lead a group of individual contributors covering several User Well-Being policy areas.
• Serve as primary contact for content review partners, covering onboarding, training, QA, and ongoing relationship management.
• Design enforcement workflows that scale with volume while keeping review decisions accurate and consistent.
• Partner with Engineering and Data Science to tune detection models and automated enforcement for User Well-Being policies.
• Write and maintain decision trees, review guidelines, and internal enforcement documentation.
• Report misuse trends to Policy, Legal, and Trust & Safety leadership.
• Coordinate external reporting obligations, such as to NCMEC, under applicable law and company policy.

What it asks for

• Prior people management in the User Well-Being area.
• Background in T&S, moderation operations, or enforcement touching child safety, mental health, abuse and exploitation, or age assurance.
• Hands-on experience running content review operations, including QA oversight and workflow management.
• Track record building out enforcement or content review workflows from the ground up.
• SQL or similar analysis tools for watching queue health and spotting trends.
• Experience communicating emerging risks to Product, Policy, Engineering, and Legal.
• Deep expertise in child safety, CSEA, online child protection, mental wellness, or age assurance (preferred).

Worth knowing

• Regular exposure to explicit sexual content involving minors, and to violent or psychologically disturbing content.
• Access to wellness resources and support offered for this exposure.

Terms in this role

COPPA.

The Children's Online Privacy Protection Act, a US law. A service aimed at children, or that knows a user is under 13, needs verifiable parental consent before collecting their personal data.

CSAM.

Child sexual abuse material: images or video of the sexual abuse of children. Illegal to make, share or possess in nearly every country.

CSEA.

Child sexual exploitation and abuse. The wider harm area around CSAM, including grooming, sextortion and trafficking.

NCMEC.

The National Center for Missing & Exploited Children, a US nonprofit. It runs the CyberTipline, where US-based online services must report apparent child sexual abuse material they find.

Hash matching.

Comparing a digital fingerprint of an image or video against lists of known violating content. PhotoDNA, from Microsoft, is the best-known tool for it.

Age assurance.

Ways of checking or estimating a user's age, from asking them to facial age estimation and ID checks.

Our best summary of the posting, and it can be wrong. The employer's posting is what counts: read it in full on Anthropicnorth_east before you apply. If we got something wrong, report this listing.