Hate Speech
Attacks on people for who they are, judged against a policy that has to hold up in every language a service serves.
51 entries
Aegis Content SafetyNVIDIA's dataset for content moderation and toxicity detection.Datasets and benchmarks · Open source
Discord AutoModKeyword and pattern rules that block a message before it is posted.Community management · Free1 review
Jigsaw ToxicityWikipedia comments labeled by human raters for toxic behavior.Datasets and benchmarks · Open source
YouTube moderation toolsComment filtering, held for review, blocked words and live chat controls for creators.Community management · Free
AliceDetection and intelligence on harmful content across text, image, video and audio.Threat intelligence · Enterprise
Alorica Trust and SafetyOutsourced content moderation, identity fraud and financial fraud operations.Moderation outsourcing · Service
Amazon TranscribeSpeech to text on AWS, including toxicity detection for audio.Image and video analysis · Usage based
Azure AI Content SafetyHosted classifiers scoring text and images across the main harm categories.AI content classifiers · Usage basedBodyguardReal time detection of toxic content in comments, chat and social feeds.Content moderation platforms · Subscription
CheckstepModeration workflows, classifiers and regulatory reporting in one platform.Content moderation platforms · Subscription
CinderTrust and Safety operating system: queues, cases, policy and enforcement.Case management · Enterprise
Community SiftChat and username filtering for games and children's products, from Two Hat.Content moderation platforms · Enterprise
CoPESmall open model that classifies content against a policy you define.AI content classifiers · Open source
DetoxifyOpen models scoring text for toxicity, threats and identity attacks.Text and language analysis · Open source
DiscourseOpen source forum platform with trust levels, flagging and moderation built in.Community management · Open source
Foiwe Content Moderation ServicesBengaluru-based human and AI moderation of text, images, video and live streams, 24x7.Moderation outsourcing · Service
FossabotTwitch chat bot with strong spam and hate raid protection.Community management · Free
Gemini API safety settingsConfigurable harm filters built into the Gemini API.AI guardrails · Free
Genpact Trust and SafetyContent moderation and trust and safety operations, run from a central analytics control tower.Moderation outsourcing · Service
gpt-oss-safeguardOpen weight reasoning model that classifies text against a policy you write.AI content classifiers · Open source
Granite GuardianOpen guardrail models for detecting harms in LLM traffic.AI guardrails · Open sourceHateBERTBERT retrained on banned Reddit communities for abusive language detection.Text and language analysis · Open source
Hive Audio ModerationSpeech transcription and moderation for uploaded audio, video and live voice chat.AI content classifiers · Usage based
Hive ModerationCloud APIs classifying text, image, video and audio for harmful content.Content moderation platforms · Usage based
Hive Text ModerationText classifier for sexual content, threats, bullying, hate, drugs and spam.Text and language analysis · Usage based
Hive Vision Language ModelMultimodal model that enforces a policy written as a prompt across images, video and text.AI content classifiers · Usage based
Hive Visual ModerationImage and video classifier for nudity, violence, drugs and hate imagery.Image and video analysis · Usage based
iMerit Content ModerationExpert-led image, video and text moderation, plus red teaming and annotation for AI safety.Moderation outsourcing · Service
Innodata Model Safety and Red TeamingHuman and automated red teaming of generative AI models, plus 24/7 content moderation.Red teaming and evaluation · ServiceLemmy moderationModeration tools built into the open source federated link aggregator.Community management · Open source
Llama GuardOpen weight model that checks prompts and responses against a written policy.AI guardrails · Open source
Mastodon moderationReports, account actions, filters and domain blocks built into Mastodon.Community management · Open source
Open MeasuresSearch and analysis across alternative and fringe platforms.Data and analytics · Freemium
OpenAI Moderation APIFree classifier covering the main harm categories, for anyone using the API.AI content classifiers · Free
OSmodOpen source moderation tooling and APIs from Jigsaw.Content moderation platforms · Open source
OzoneOpen source labeling and moderation console for the AT Protocol.Case management · Open source
Perspective APIFree toxicity scoring for comments and conversation, from Jigsaw.Text and language analysis · FreeResolverAnalyst-led trust and safety intelligence for platforms, monitored around the clock.Threat intelligence · Service
Roblox Voice Safety ClassifierOpen model flagging harmful speech in live voice chat.AI content classifiers · Open source
ShieldGemmaOpen weight safety classifiers for model inputs and outputs.AI guardrails · Open source
SpeechmaticsMultilingual speech recognition API with strong accent coverage.Image and video analysis · Usage based
Stream ModerationModeration built into the Stream chat and feeds SDKs, with AI and a review dashboard.Content moderation platforms · Usage based
SupportYourApp Content ModerationOutsourced 24/7 content moderation combining AI screening with human moderators.Moderation outsourcing · Service
Sutherland Trust and SafetyContent moderation, fraud prevention and data labeling for platforms, marketplaces and games.Moderation outsourcing · Service
ToxiGenLarge machine generated dataset of implicit hate speech across 13 minority groups.Datasets and benchmarks · Open source
ToxModVoice moderation that flags harmful speech in live audio.Content moderation platforms · Enterprise
Trust LabIndependent measurement of harmful content and support for DSA and OSA risk assessments.Regulatory compliance · Enterprise
Twitch AutoModBuilt in chat filtering for Twitch channels with adjustable strictness.Community management · Free- WebPurifyAutomated filtering with a live human moderation team behind it.Content moderation platforms · Usage based
- WebPurify Live Moderation TeamsIn-office human moderators reviewing images, video and communities around the clock.Moderation outsourcing · Service
WildGuardOpen moderation model for prompts and responses, with a benchmark of real and adversarial cases.AI guardrails · Open source
Keep a list of the ones worth a call
A free account lets you upvote these and keep them in a list of your own. We never pass your details to a vendor.
Create a free account