Tools & Services

Harassment and Bullying

Targeted abuse of one person by one account or many, and the hardest category to automate, because the same words are harmless between friends.

75 entries

Most upvotedA to Z
  • Aegis Content SafetyNVIDIA's dataset for content moderation and toxicity detection.Datasets and benchmarks · Open source
  • Block PartyConsumer tools for filtering harassment and locking down personal social accounts.Community management · Subscription
  • Bluesky automodRules engine for automated moderation on AT Protocol services.Community management · Open source
  • CoralOpen source commenting platform with moderation built into it.Community management · Open source
  • Discord AutoModKeyword and pattern rules that block a message before it is posted.Community management · Free
  • FIRESShared moderation advisories and label distribution between fediverse servers.Community management · Open source
  • Jigsaw ToxicityWikipedia comments labeled by human raters for toxic behavior.Datasets and benchmarks · Open source
  • OspreyOpen source rules engine for anti-abuse decisions, first built at Discord.Content moderation platforms · Open source
  • YouTube moderation toolsComment filtering, held for review, blocked words and live chat controls for creators.Community management · Free
  • Alorica Trust and SafetyOutsourced content moderation, identity fraud and financial fraud operations.Moderation outsourcing · Service
  • Amazon TranscribeSpeech to text on AWS, including toxicity detection for audio.Image and video analysis · Usage based
  • Azure AI Content SafetyHosted classifiers scoring text and images across the main harm categories.AI content classifiers · Usage based
  • BodyguardReal time detection of toxic content in comments, chat and social feeds.Content moderation platforms · Subscription
  • CheckstepModeration workflows, classifiers and regulatory reporting in one platform.Content moderation platforms · Subscription
  • CinderTrust and Safety operating system: queues, cases, policy and enforcement.Case management · Enterprise
  • Community SiftChat and username filtering for games and children's products, from Two Hat.Content moderation platforms · Enterprise
  • Cooley Trust, Platforms and SafetyEU and UK counsel on the DSA, the Online Safety Act and overlapping content laws for online services.Legal counsel · Service
  • CoopOpen source content review and enforcement: queues, routing, enforcement rules and reporting to NCMEC.Case management · Open source
  • CoPESmall open model that classifies content against a policy you define.AI content classifiers · Open source
  • DeepgramFast speech to text and audio intelligence API for developers.Image and video analysis · Usage based
  • DetoxifyOpen models scoring text for toxicity, threats and identity attacks.Text and language analysis · Open source
  • DiscourseOpen source forum platform with trust levels, flagging and moderation built in.Community management · Open source
  • FeludaOpen engine for analyzing multilingual, multimodal content at scale.Data and analytics · Open source
  • Foiwe Content Moderation ServicesBengaluru-based human and AI moderation of text, images, video and live streams, 24x7.Moderation outsourcing · Service
  • FossabotTwitch chat bot with strong spam and hate raid protection.Community management · Free
  • Foundever Trust and SafetyModeration of user content and ads, copyright compliance and fraud detection in 60 languages.Moderation outsourcing · Service
  • Gemini API safety settingsConfigurable harm filters built into the Gemini API.AI guardrails · Free
  • gpt-oss-safeguardOpen weight reasoning model that classifies text against a policy you write.AI content classifiers · Open source
  • Granite GuardianOpen guardrail models for detecting harms in LLM traffic.AI guardrails · Open source
  • HateBERTBERT retrained on banned Reddit communities for abusive language detection.Text and language analysis · Open source
  • Hive Audio ModerationSpeech transcription and moderation for uploaded audio, video and live voice chat.AI content classifiers · Usage based
  • Hive ModerationCloud APIs classifying text, image, video and audio for harmful content.Content moderation platforms · Usage based
  • Hive Text ModerationText classifier for sexual content, threats, bullying, hate, drugs and spam.Text and language analysis · Usage based
  • HoleheChecks whether an email address is registered on many sites without alerting the owner.Investigations and OSINT · Open source
  • Innodata Model Safety and Red TeamingHuman and automated red teaming of generative AI models, plus 24/7 content moderation.Red teaming and evaluation · Service
  • Lemmy moderationModeration tools built into the open source federated link aggregator.Community management · Open source
  • Llama GuardOpen weight model that checks prompts and responses against a written policy.AI guardrails · Open source
  • MaigretUsername OSINT that also pulls profile details and links, built on Sherlock's idea.Investigations and OSINT · Open source
  • Mastodon moderationReports, account actions, filters and domain blocks built into Mastodon.Community management · Open source
  • MjolnirModeration bot enforcing shared policy lists across Matrix rooms.Community management · Open source
  • MoobotTwitch bot with spam filters, custom commands and channel management.Community management · Freemium
  • Moonshot Threat IntelligenceIntelligence products and threat protection on violent extremism, abuse and online violence.Threat intelligence · Service
  • NightbotFree chat bot for Twitch and YouTube with spam filters and custom commands.Community management · Free
  • Nisos Platform ProtectionAnalyst-led investigations, monitoring and assessments of abuse, disinformation and threats for online platforms.Investigations and OSINT · Service
  • OpenAI Moderation APIFree classifier covering the main harm categories, for anyone using the API.AI content classifiers · Free
  • OpenWebHosted conversation platform with moderation for publisher comment sections.Community management · Enterprise
  • OSmodOpen source moderation tooling and APIs from Jigsaw.Content moderation platforms · Open source
  • OzoneOpen source labeling and moderation console for the AT Protocol.Case management · Open source
  • Perspective APIFree toxicity scoring for comments and conversation, from Jigsaw.Text and language analysis · Free
  • PolicyKitToolkit for building and running community governance rules.Community management · Open source
  • Private DetectorOpen model for identifying unsolicited lewd images.Image and video analysis · Open source
  • Reddit AutoModeratorRule based automation that acts on posts and comments in a subreddit.Community management · Free
  • ResolverAnalyst-led trust and safety intelligence for platforms, monitored around the clock.Threat intelligence · Service
  • Roblox Voice Safety ClassifierOpen model flagging harmful speech in live voice chat.AI content classifiers · Open source
  • Safety KitAPI first moderation platform: custom classifiers, policy engine and enforcement in one.Content moderation platforms · Enterprise
  • Sendbird ModerationProfanity filters, image moderation and moderator tools inside the Sendbird chat platform.Content moderation platforms · Usage based
  • SherlockOpen source username search across hundreds of sites.Investigations and OSINT · Open source
  • ShieldGemmaOpen weight safety classifiers for model inputs and outputs.AI guardrails · Open source
  • SightengineLow latency image, video and text moderation APIs.Content moderation platforms · Usage based
  • SpeechmaticsMultilingual speech recognition API with strong accent coverage.Image and video analysis · Usage based
  • SquadboxFriend sourced moderation of your own inbox: a helper screens messages on your behalf.Community management · Open source
  • Stanford Trust and Safety (CS 152)Ten-week Stanford course on how online services are abused and the operational, product and engineering responses.Training and certification · Service
  • StopNCII.orgHash based removal of intimate images shared without consent.Hash matching and databases · Free
  • Stream ModerationModeration built into the Stream chat and feeds SDKs, with AI and a review dashboard.Content moderation platforms · Usage based
  • SupportYourApp Content ModerationOutsourced 24/7 content moderation combining AI screening with human moderators.Moderation outsourcing · Service
  • Sutherland Trust and SafetyContent moderation, fraud prevention and data labeling for platforms, marketplaces and games.Moderation outsourcing · Service
  • Toxic ChatToxic conversations collected from real interactions with a chat assistant.Datasets and benchmarks · Open source
  • ToxModVoice moderation that flags harmful speech in live audio.Content moderation platforms · Enterprise
  • Twitch AutoModBuilt in chat filtering for Twitch channels with adjustable strictness.Community management · Free
  • UliBrowser extension and crowd sourced slur list for reducing online gendered harassment.Community management · Open source
  • Uli DatasetGendered abuse data, created for Tattle's Uli redaction model.Datasets and benchmarks · Open source
  • WebPurifyAutomated filtering with a live human moderation team behind it.Content moderation platforms · Usage based
  • WebPurify Live Moderation TeamsIn-office human moderators reviewing images, video and communities around the clock.Moderation outsourcing · Service
  • WildGuardOpen moderation model for prompts and responses, with a benchmark of real and adversarial cases.AI guardrails · Open source
  • ZwillGen Trust, Safety, & Reporting ObligationsCounsel on NCMEC reporting programs, community guidelines and escalation protocols for sensitive content.Legal counsel · Service

Keep a list of the ones worth a call

A free account lets you upvote these and keep them in a list of your own. We never pass your details to a vendor.

Create a free account