Trust & Safety Tools and Services

Alice AI Red TeamingExpert-led and automated red teaming of foundation models across text, image, audio and video.Red teaming and evaluation · Service
AymaraAutomated evaluations for AI safety, accuracy and jailbreak vulnerability.Red teaming and evaluation · Open source
Bugcrowd AI Safety and SecurityCrowdsourced AI red teaming, AI penetration tests, bias assessments and bug bounties for AI systems.Red teaming and evaluation · Service
CounterfitAutomation for assessing the security and robustness of AI models.Red teaming and evaluation · Open source
DeepEvalOpen source LLM evaluation with pytest style tests and a red teaming module.Red teaming and evaluation · Open source
GarakFramework for adversarial testing and evaluation of language models.Red teaming and evaluation · Open source
GiskardOpen source testing for LLM and ML apps, with a scan for common vulnerabilities.Red teaming and evaluation · Open source
HackerOne AI Red TeamingTime-boxed adversarial testing of AI models, agents and apps by vetted outside researchers.Red teaming and evaluation · Service
Humane Intelligence Red TeamingDesigns and runs public and expert red teaming exercises for AI systems as a paid service.Red teaming and evaluation · Service
Innodata Model Safety and Red TeamingHuman and automated red teaming of generative AI models, plus 24/7 content moderation.Red teaming and evaluation · Service
InspectOpen evaluation framework for LLMs from the UK AI Security Institute, widely adopted.Red teaming and evaluation · Open source
LangSmith EvaluationEvaluation and tracing for LLM apps built with or without LangChain.Red teaming and evaluation · Freemium
LLM CanaryEvaluates models for security vulnerabilities and adversarial robustness.Red teaming and evaluation · Open source
LXT LLM Red Teaming and Safety EvaluationHuman-led adversarial testing of LLMs for jailbreaks, toxicity, bias and hallucination.Red teaming and evaluation · Service
OWASP Top 10 for LLM ApplicationsThe reference list of security risks in LLM applications.Red teaming and evaluation · Free
Prompt FuzzerTests prompt injection weaknesses in systems built on language models.Red teaming and evaluation · Open source
PromptfooAutomated model evaluations with ready made attack strategies and reports.Red teaming and evaluation · Open source
PyRITMicrosoft's Python toolkit for AI red teaming and security testing.Red teaming and evaluation · Open source
Trail of Bits AI/ML SecuritySecurity assessments of AI systems end to end, including model capability evaluations.Red teaming and evaluation · Service