AI Content Classifiers
Models that score content against a policy so a person doesn't have to look at all of it.
9 tools
Azure AI Content SafetyHosted classifiers scoring text and images across the main harm categories.AI content classifiers · Usage based
CoPESmall open model that classifies content against a policy you define.AI content classifiers · Open source
gpt-oss-safeguardOpen weight reasoning model that classifies text against a policy you write.AI content classifiers · Open source
Hive Audio ModerationSpeech transcription and moderation for uploaded audio, video and live voice chat.AI content classifiers · Usage based- Hive Vision Language ModelMultimodal model that enforces a policy written as a prompt across images, video and text.AI content classifiers · Usage based
- OpenAI Moderation APIFree classifier covering the main harm categories, for anyone using the API.AI content classifiers · Free
Roblox SentinelRoblox's open source classifier for detecting child endangerment signals in chat.AI content classifiers · Open source- Roblox Voice Safety ClassifierOpen model flagging harmful speech in live voice chat.AI content classifiers · Open source
- ZentropiBuild and run content labelers from policies written in plain English, by web app or API.AI content classifiers · Freemium
What to ask before you buy
- What is your recall and precision on my harms, in my languages, at my volume? Not in general.
- What happens when you're wrong, and how does a person override it?
- Where does my data sit, who can read it, and what happens to it when we leave?
- What does the price do when our volume doubles? Show me the tier boundaries.
- Who else my size uses this, and can I speak to one of them without you present?
- What is your incident process when your service is down and my queue is filling?
Rules that push teams here
Not legal advice
- The Digital Services ActRisk assessment, transparency reporting, and a working appeals route.
- The Online Safety ActDuties that scale with your size and your users' age.
Keep a list of the ones worth a call
A free account lets you upvote these and keep them in a list of your own. We never pass your details to a vendor.
Create a free account