Trust & Safety Tools and Services
Filters3
Category
- Any category
- Age assurance0
- AI content classifiers3
- AI governance0
- AI guardrails4
- Appeals and redress0
- Audit and reporting0
- Bot and automation defense0
- Case management2
- Community management10
- Content moderation platforms2
- Crisis and incident response0
- CSAM detection0
- Data and analytics1
- Data labeling and annotation0
- Datasets and benchmarks4
- Deepfake detection and provenance0
- Fraud and payments risk0
- Hash matching and databases0
- Identity verification0
- Image and video analysis1
- Investigations and OSINT3
- Legal counsel0
- Moderation outsourcing0
- Policy management0
- Recruiting and staffing0
- Red teaming and evaluation0
- Regulatory compliance0
- Text and language analysis2
- Threat intelligence0
- Training and certification0
- Wellbeing and resilience0
Cost
Harm area
- Any harm area
- Child sexual abuse material8
- Child safety and grooming3
- Terrorism and violent extremism6
- Harassment and bullying32
- Hate speech17
- Self harm and suicide6
- Fraud and scams6
- Spam and platform abuse16
- Misinformation3
- Coordinated manipulation3
- Counterfeits and IP0
- Adult and sexual content13
- Privacy and doxxing1
- AI misuse and jailbreaks26
Deployment
Data location
Standards
- Any standards
- EU Digital Services Act0
- UK Online Safety Act0
- Australian Online Safety Act0
- EU Terrorist Content Regulation0
- GDPR0
- COPPA0
- Age Appropriate Design Code0
- California AB 5870
- NCMEC reporting duties1
- EU AI Act0
- Santa Clara Principles0
- Digital Trust & Safety Partnership0
- Tech Coalition0
- GIFCT0
- IWF membership0
- Christchurch Call0
- NIST AI Risk Management Framework0
- SOC 20
- ISO 270010
- ISO/IEC 420010
Aegis Content SafetyNVIDIA's dataset for content moderation and toxicity detection.Datasets and benchmarks · Open source
Bluesky automodRules engine for automated moderation on AT Protocol services.Community management · Open source
CoopOpen source content review and enforcement: queues, routing, enforcement rules and reporting to NCMEC.Case management · Open source
CoPESmall open model that classifies content against a policy you define.AI content classifiers · Open source
CoralOpen source commenting platform with moderation built into it.Community management · Open source
DetoxifyOpen models scoring text for toxicity, threats and identity attacks.Text and language analysis · Open source
DiscourseOpen source forum platform with trust levels, flagging and moderation built in.Community management · Open source
FeludaOpen engine for analyzing multilingual, multimodal content at scale.Data and analytics · Open source
FIRESShared moderation advisories and label distribution between fediverse servers.Community management · Open source
gpt-oss-safeguardOpen weight reasoning model that classifies text against a policy you write.AI content classifiers · Open source
Granite GuardianOpen guardrail models for detecting harms in LLM traffic.AI guardrails · Open sourceHateBERTBERT retrained on banned Reddit communities for abusive language detection.Text and language analysis · Open source
HoleheChecks whether an email address is registered on many sites without alerting the owner.Investigations and OSINT · Open source
Jigsaw ToxicityWikipedia comments labeled by human raters for toxic behavior.Datasets and benchmarks · Open source
Lemmy moderationModeration tools built into the open source federated link aggregator.Community management · Open source
Llama GuardOpen weight model that checks prompts and responses against a written policy.AI guardrails · Open sourceMaigretUsername OSINT that also pulls profile details and links, built on Sherlock's idea.Investigations and OSINT · Open source
Mastodon moderationReports, account actions, filters and domain blocks built into Mastodon.Community management · Open source
MjolnirModeration bot enforcing shared policy lists across Matrix rooms.Community management · Open source- OSmodOpen source moderation tooling and APIs from Jigsaw.Content moderation platforms · Open source