Red Team Tooling
Overview
AI red team tooling breaks into three categories:
| Category | Purpose | Examples |
|---|---|---|
| Scanning | Automated vulnerability detection | Garak, Promptfoo |
| Orchestration | Multi-turn attack automation | PyRIT, custom scripts |
| Research | Adversarial ML experimentation | ART, TextAttack |
Subsections
- Building a Local Lab — hardware, models, inference stack
- Garak — LLM vulnerability scanner
- PyRIT — Microsoft's AI red team framework
- Promptfoo — LLM evaluation and testing
- ART — Adversarial Robustness Toolbox
- Building Custom Tooling — roll your own