Rainbow Teaming

paper
University College London , Meta

Open-ended generation of diverse adversarial prompts (NeurIPS 2024): quality-diversity search (MAP-Elites) applied to automated red-teaming, used in Llama safety tuning. A Meta-led joint with UCL coauthors (Samvelyan, Rocktäschel, Raileanu).

Paper (arXiv)

Paper

Venue NeurIPS 2024
arXiv HTML
researchsafety