Trust & Safety Tools and Services

Discord AutoModKeyword and pattern rules that block a message before it is posted.Community management · Free1 review
Aegis Content SafetyNVIDIA's dataset for content moderation and toxicity detection.Datasets and benchmarks · Open source
AliceDetection and intelligence on harmful content across text, image, video and audio.Threat intelligence · Enterprise
Alorica Trust and SafetyOutsourced content moderation, identity fraud and financial fraud operations.Moderation outsourcing · Service
Amazon TranscribeSpeech to text on AWS, including toxicity detection for audio.Image and video analysis · Usage based
Azure AI Content SafetyHosted classifiers scoring text and images across the main harm categories.AI content classifiers · Usage based
BodyguardReal time detection of toxic content in comments, chat and social feeds.Content moderation platforms · Subscription
CheckstepModeration workflows, classifiers and regulatory reporting in one platform.Content moderation platforms · Subscription
CinderTrust and Safety operating system: queues, cases, policy and enforcement.Case management · Enterprise
Community SiftChat and username filtering for games and children's products, from Two Hat.Content moderation platforms · Enterprise
CoPESmall open model that classifies content against a policy you define.AI content classifiers · Open source
DetoxifyOpen models scoring text for toxicity, threats and identity attacks.Text and language analysis · Open source
DiscourseOpen source forum platform with trust levels, flagging and moderation built in.Community management · Open source
Foiwe Content Moderation ServicesBengaluru-based human and AI moderation of text, images, video and live streams, 24x7.Moderation outsourcing · Service
FossabotTwitch chat bot with strong spam and hate raid protection.Community management · Free
Gemini API safety settingsConfigurable harm filters built into the Gemini API.AI guardrails · Free
Genpact Trust and SafetyContent moderation and trust and safety operations, run from a central analytics control tower.Moderation outsourcing · Service
gpt-oss-safeguardOpen weight reasoning model that classifies text against a policy you write.AI content classifiers · Open source
Granite GuardianOpen guardrail models for detecting harms in LLM traffic.AI guardrails · Open source
HateBERTBERT retrained on banned Reddit communities for abusive language detection.Text and language analysis · Open source