Trust & Safety Tools and Services
Filters1
Category
- Any category
- Age assurance9
- AI content classifiers9
- AI governance9
- AI guardrails11
- Appeals and redress4
- Audit and reporting11
- Bot and automation defense13
- Case management7
- Community management21
- Content moderation platforms13
- Crisis and incident response6
- CSAM detection12
- Data and analytics9
- Data labeling and annotation14
- Datasets and benchmarks20
- Deepfake detection and provenance10
- Fraud and payments risk31
- Hash matching and databases13
- Identity verification26
- Image and video analysis11
- Investigations and OSINT23
- Legal counsel10
- Moderation outsourcing21
- Policy management10
- Recruiting and staffing4
- Red teaming and evaluation25
- Regulatory compliance24
- Text and language analysis7
- Threat intelligence24
- Training and certification2
- Wellbeing and resilience17
Cost
Harm area
- Any harm area
- Child sexual abuse material0
- Child safety and grooming0
- Terrorism and violent extremism0
- Harassment and bullying5
- Hate speech5
- Self harm and suicide2
- Fraud and scams0
- Spam and platform abuse0
- Misinformation0
- Coordinated manipulation4
- Counterfeits and IP0
- Adult and sexual content5
- Privacy and doxxing3
- AI misuse and jailbreaks11
Deployment
Data location
Standards
- Any standards
- EU Digital Services Act0
- UK Online Safety Act0
- Australian Online Safety Act0
- EU Terrorist Content Regulation0
- GDPR0
- COPPA0
- Age Appropriate Design Code0
- California AB 5870
- NCMEC reporting duties0
- EU AI Act0
- Santa Clara Principles0
- Digital Trust & Safety Partnership0
- Tech Coalition0
- GIFCT0
- IWF membership0
- Christchurch Call0
- NIST AI Risk Management Framework0
- SOC 20
- ISO 270010
- ISO/IEC 420010
Arthur ShieldLLM firewall and evaluation from an ML observability vendor.AI guardrails · Enterprise
Gemini API safety settingsConfigurable harm filters built into the Gemini API.AI guardrails · Free
Granite GuardianOpen guardrail models for detecting harms in LLM traffic.AI guardrails · Open source
Guardrails AIPython framework for validating what goes into and comes out of a model.AI guardrails · Open source
Lakera GuardHosted detection of prompt injection, jailbreaks and data leakage for LLM apps.AI guardrails · Usage based
Llama GuardOpen weight model that checks prompts and responses against a written policy.AI guardrails · Open sourceNeMo GuardrailsToolkit for programmable rails around LLM apps: topic, safety, jailbreak and fact checks.AI guardrails · Open source
Prompt SecurityRuntime protection for GenAI apps and employee GenAI use.AI guardrails · Enterprise
Protect AIAI security platform: LLM firewall, model scanning and red teaming, now part of Palo Alto Networks.AI guardrails · Enterprise- ShieldGemmaOpen weight safety classifiers for model inputs and outputs.AI guardrails · Open source
WildGuardOpen moderation model for prompts and responses, with a benchmark of real and adversarial cases.AI guardrails · Open source