Trust & Safety Tools and Services
Filters1
Category
- Any category
- Age assurance0
- AI content classifiers5
- AI governance0
- AI guardrails2
- Appeals and redress0
- Audit and reporting0
- Bot and automation defense0
- Case management0
- Community management0
- Content moderation platforms3
- Crisis and incident response0
- CSAM detection0
- Data and analytics0
- Data labeling and annotation1
- Datasets and benchmarks2
- Deepfake detection and provenance0
- Fraud and payments risk0
- Hash matching and databases0
- Identity verification0
- Image and video analysis0
- Investigations and OSINT0
- Legal counsel1
- Moderation outsourcing1
- Policy management0
- Recruiting and staffing0
- Red teaming and evaluation1
- Regulatory compliance1
- Text and language analysis0
- Threat intelligence1
- Training and certification1
- Wellbeing and resilience0
Cost
Harm area
- Any harm area
- Child sexual abuse material30
- Child safety and grooming33
- Terrorism and violent extremism30
- Harassment and bullying75
- Hate speech51
- Self harm and suicide16
- Fraud and scams117
- Spam and platform abuse59
- Misinformation31
- Coordinated manipulation22
- Counterfeits and IP16
- Adult and sexual content47
- Privacy and doxxing15
- AI misuse and jailbreaks41
Deployment
Data location
Standards
- Any standards
- EU Digital Services Act1
- UK Online Safety Act1
- Australian Online Safety Act0
- EU Terrorist Content Regulation0
- GDPR0
- COPPA0
- Age Appropriate Design Code0
- California AB 5870
- NCMEC reporting duties1
- EU AI Act0
- Santa Clara Principles0
- Digital Trust & Safety Partnership0
- Tech Coalition0
- GIFCT0
- IWF membership0
- Christchurch Call0
- NIST AI Risk Management Framework0
- SOC 20
- ISO 270010
- ISO/IEC 420010
Aegis Content SafetyNVIDIA's dataset for content moderation and toxicity detection.Datasets and benchmarks · Open source
Azure AI Content SafetyHosted classifiers scoring text and images across the main harm categories.AI content classifiers · Usage based
CoPESmall open model that classifies content against a policy you define.AI content classifiers · Open source
gpt-oss-safeguardOpen weight reasoning model that classifies text against a policy you write.AI content classifiers · Open source
Hive Audio ModerationSpeech transcription and moderation for uploaded audio, video and live voice chat.AI content classifiers · Usage based- Hive ModerationCloud APIs classifying text, image, video and audio for harmful content.Content moderation platforms · Usage based
Innodata Model Safety and Red TeamingHuman and automated red teaming of generative AI models, plus 24/7 content moderation.Red teaming and evaluation · Service
Llama GuardOpen weight model that checks prompts and responses against a written policy.AI guardrails · Open source- MedSafetyBenchMedical safety prompts for evaluating model safety in medical contexts.Datasets and benchmarks · Open source
- OpenAI Moderation APIFree classifier covering the main harm categories, for anyone using the API.AI content classifiers · Free
ResolverAnalyst-led trust and safety intelligence for platforms, monitored around the clock.Threat intelligence · Service
Stanford Trust and Safety (CS 152)Ten-week Stanford course on how online services are abused and the operational, product and engineering responses.Training and certification · Service
ToxModVoice moderation that flags harmful speech in live audio.Content moderation platforms · Enterprise
UnitaryContext aware video moderation, read frame by frame.Content moderation platforms · Enterprise
WildGuardOpen moderation model for prompts and responses, with a benchmark of real and adversarial cases.AI guardrails · Open source
ZwillGen Trust, Safety, & Reporting ObligationsCounsel on NCMEC reporting programs, community guidelines and escalation protocols for sensitive content.Legal counsel · Service