Google

Altitude

Free desktop tool for reviewing and hash matching violent extremist content.

Crisis and incident responseOpen source

Cloud Vision SafeSearch

Flags adult, violent, medical and racy imagery.

Image and video analysisUsage based

Content Safety API

Classifier that finds novel abuse imagery and prioritizes it for review.

CSAM detectionFree to qualifying organizations

CSAI Match

Video hash matching for known child sexual abuse material.

CSAM detectionFree to qualifying organizations

Gemini API safety settings

Configurable harm filters built into the Gemini API.

AI guardrailsFree

Google Safe Browsing

Free API to check URLs against Google's lists of phishing, malware and unwanted software sites.

Threat intelligenceFree

Jigsaw Toxicity

Wikipedia comments labeled by human raters for toxic behavior.

Datasets and benchmarksOpen source

OSmod

Open source moderation tooling and APIs from Jigsaw.

Content moderation platformsOpen source

Perspective API

Free toxicity scoring for comments and conversation, from Jigsaw.

Text and language analysisFree

reCAPTCHA

Bot detection for web and mobile, scored in the background rather than solved.

Bot and automation defenseFreemium

ShieldGemma

Open weight safety classifiers for model inputs and outputs.

AI guardrailsOpen source

SynthID

Watermarking and detection for AI generated images, audio, video and text from Google models.

Deepfake detection and provenanceFree

YouTube Content ID

YouTube's automated system for matching uploads against rights holders' reference files.

Hash matching and databasesFree

YouTube moderation tools

Comment filtering, held for review, blocked words and live chat controls for creators.

Community managementFree