Trust & Safety Tools and Services

Block PartyConsumer tools for filtering harassment and locking down personal social accounts.Community management · Subscription1 review
Discord AutoModKeyword and pattern rules that block a message before it is posted.Community management · Free1 review
Aegis Content SafetyNVIDIA's dataset for content moderation and toxicity detection.Datasets and benchmarks · Open source
Alorica Trust and SafetyOutsourced content moderation, identity fraud and financial fraud operations.Moderation outsourcing · Service
Amazon TranscribeSpeech to text on AWS, including toxicity detection for audio.Image and video analysis · Usage based
Azure AI Content SafetyHosted classifiers scoring text and images across the main harm categories.AI content classifiers · Usage based
Bluesky automodRules engine for automated moderation on AT Protocol services.Community management · Open source
BodyguardReal time detection of toxic content in comments, chat and social feeds.Content moderation platforms · Subscription
CheckstepModeration workflows, classifiers and regulatory reporting in one platform.Content moderation platforms · Subscription
CinderTrust and Safety operating system: queues, cases, policy and enforcement.Case management · Enterprise
Community SiftChat and username filtering for games and children's products, from Two Hat.Content moderation platforms · Enterprise
Cooley Trust, Platforms and SafetyEU and UK counsel on the DSA, the Online Safety Act and overlapping content laws for online services.Legal counsel · Service
CoopOpen source content review and enforcement: queues, routing, enforcement rules and reporting to NCMEC.Case management · Open source
CoPESmall open model that classifies content against a policy you define.AI content classifiers · Open source
CoralOpen source commenting platform with moderation built into it.Community management · Open source
DeepgramFast speech to text and audio intelligence API for developers.Image and video analysis · Usage based
DetoxifyOpen models scoring text for toxicity, threats and identity attacks.Text and language analysis · Open source
DiscourseOpen source forum platform with trust levels, flagging and moderation built in.Community management · Open source
FeludaOpen engine for analyzing multilingual, multimodal content at scale.Data and analytics · Open source
FIRESShared moderation advisories and label distribution between fediverse servers.Community management · Open source