Skip to content
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
85 changes: 82 additions & 3 deletions CITATION.cff
Original file line number Diff line number Diff line change
@@ -1,8 +1,87 @@
cff-version: 1.2.0
message: "If you use this software, please cite it as below."
message: "If you use this software, please cite the paper below."
authors:
- family-names: "Microsoft, AI Red Team"
- name: "Microsoft, AI Red Team"
title: "PyRIT: The Python Risk Identification Tool for generative AI"
doi: https://doi.org/10.48550/arXiv.2410.02828
date-released: 2024-02-21
url: "https://github.com/microsoft/PyRIT"
preferred-citation:
type: report
title: "PyRIT: Democratizing AI Red Teaming Through Open-Source Tooling"
authors:
- family-names: "Lutz"
given-names: "Roman"
- family-names: "Kim"
given-names: "Eugenia"
- family-names: "Lundeen"
given-names: "Richard"
- family-names: "Chikanov"
given-names: "Nina"
- family-names: "Gavrila"
given-names: "Adrian"
- family-names: "Jagdagdorj"
given-names: "Bolor-Erdene"
- family-names: "Joginpalli"
given-names: "Varun"
- family-names: "Kohlenberg"
given-names: "Toby"
- family-names: "Ousat"
given-names: "Behnam"
- family-names: "Partovi"
given-names: "Bashir"
- family-names: "Schoenberg"
given-names: "Spencer"
- family-names: "Song"
given-names: "Justin"
- family-names: "Valbuena"
given-names: "Victor"
- family-names: "Westra"
given-names: "Hannah"
- family-names: "Bryan"
given-names: "Pete"
- family-names: "Bullwinkel"
given-names: "Blake"
- family-names: "Chawla"
given-names: "Shiven"
- family-names: "Dubut"
given-names: "Fr\u00e9d\u00e9ric"
- family-names: "de Gruyter"
given-names: "Joris"
- family-names: "Maxwell"
given-names: "Whitney"
- family-names: "Minnich"
given-names: "Amanda"
- family-names: "Mirza"
given-names: "Shujaat"
- family-names: "Ovadiuc"
given-names: "Cristian"
- family-names: "Phillips"
given-names: "Teddy"
- family-names: "Pouliot"
given-names: "Martin"
- family-names: "Pratt"
given-names: "Katherine"
- family-names: "Qi"
given-names: "Saphir"
- family-names: "Severi"
given-names: "Giorgio"
- family-names: "Mori Tornheim"
given-names: "Elizabeth"
- family-names: "Varga"
given-names: "Csenge"
- family-names: "Vaughan"
given-names: "Sam"
- family-names: "Westerhoff"
given-names: "Victoria"
- family-names: "Siva Kumar"
given-names: "Ram Shankar"
- family-names: "Russinovich"
given-names: "Mark"
- family-names: "Zunger"
given-names: "Yonatan"
institution:
name: "Microsoft"
year: 2026
month: 9
date-published: 2026-09-10
url: "https://commandline.microsoft.com/wp-content/uploads/2026/08/PyRIT_Whitepaper_2026.pdf"
4 changes: 3 additions & 1 deletion README.md
Original file line number Diff line number Diff line change
Expand Up @@ -22,4 +22,6 @@ not cause confusion or imply Microsoft sponsorship.
Any use of third-party trademarks or logos are subject to those third-party's
policies.

If you use PyRIT in your research, please cite the tool itself following the [`CITATION.cff`](./CITATION.cff) file in the root of this repository.
If you use PyRIT in your research, please cite our paper,
[PyRIT: Democratizing AI Red Teaming Through Open-Source Tooling](https://commandline.microsoft.com/wp-content/uploads/2026/08/PyRIT_Whitepaper_2026.pdf),
using the citation in the [`CITATION.cff`](./CITATION.cff) file in the root of this repository.
2 changes: 1 addition & 1 deletion doc/bibliography.md
Original file line number Diff line number Diff line change
Expand Up @@ -5,6 +5,6 @@ All academic papers, research blogs, and technical reports referenced throughout
:::{dropdown} Citation Keys
:class: hidden-citations

[@aakanksha2024multilingual; @adversaai2023universal; @ahn2025puzzled; @andriushchenko2024tense; @anthropic2024manyshot; @aqrawi2024singleturncrescendo; @atr2026; @bethany2024mathprompt; @bhardwaj2023harmfulqa; @bhardwaj2024homer; @boucher2023trojan; @brahman2024coconot; @bryan2025agentictaxonomy; @bullwinkel2025airtlessons; @bullwinkel2025repeng; @bullwinkel2026trigger; @chao2023pair; @chao2024jailbreakbench; @choi2026xlsafetybench; @cui2024orbench; @darkbench2025; @derczynski2024garak; @ding2023wolf; @dong2025sata; @embracethered2024unicode; @embracethered2025sneakybits; @gehman2020realtoxicityprompts; @ghosh2025aegis; @ghosh2025ailuminate; @gong2025figstep; @gupta2024walledeval; @haider2024phi3safety; @han2024medsafetybench; @han2024wildguard; @hiddenlayer2025policypuppetry; @hines2024spotlighting; @huang2024bijectionlearning; @hughes2024bestofn; @inie2025summon; @ji2023beavertails; @ji2024pkusaferlhf; @jiang2025sosbench; @jones2025computeruse; @kingma2014adam; @li2024drattack; @li2024mossbench; @li2024saladbench; @li2024wmdp; @lin2023toxicchat; @liu2024flipattack; @liu2024mmsafetybench; @lopez2024pyrit; @luo2024jailbreakv; @lv2024codechameleon; @mazeika2023tdc; @mazeika2024harmbench; @mckee2024transparency; @mehrotra2023tap; @microsoft2024skeletonkey; @odin2024; @palaskar2025vlsu; @pfohl2024equitymedqa; @promptfoo2025ccp; @ren2024codeattack; @robustintelligence2024bypass; @roccia2024promptintel; @rottger2023xstest; @rottger2025msts; @russinovich2024crescendo; @russinovich2025cca; @russinovich2025price; @scheuerman2025transphobia; @shaikh2022second; @shayegani2025computeruse; @shen2023donotanything; @sheshadri2024lat; @souly2024strongreject; @stok2023ansi; @tan2026comicjailbreak; @tang2025multilingual; @tedeschi2024alert; @vantaylor2024socialbias; @vidgen2023simplesafetytests; @wang2023decodingtrust; @wang2023donotanswer; @wang2025siuo; @wang2026visualleakbench; @wei2023jailbroken; @xie2024sorrybench; @yu2023gptfuzzer; @yuan2023cipherchat; @zeng2024persuasion; @zeng2024shieldgemma; @zhang2024cbtbench; @ziems2022mic; @zong2024vlguard; @zou2023gcg]
[@aakanksha2024multilingual; @adversaai2023universal; @ahn2025puzzled; @andriushchenko2024tense; @anthropic2024manyshot; @aqrawi2024singleturncrescendo; @atr2026; @bethany2024mathprompt; @bhardwaj2023harmfulqa; @bhardwaj2024homer; @boucher2023trojan; @brahman2024coconot; @bryan2025agentictaxonomy; @bullwinkel2025airtlessons; @bullwinkel2025repeng; @bullwinkel2026trigger; @chao2023pair; @chao2024jailbreakbench; @choi2026xlsafetybench; @cui2024orbench; @darkbench2025; @derczynski2024garak; @ding2023wolf; @dong2025sata; @embracethered2024unicode; @embracethered2025sneakybits; @gehman2020realtoxicityprompts; @ghosh2025aegis; @ghosh2025ailuminate; @gong2025figstep; @gupta2024walledeval; @haider2024phi3safety; @han2024medsafetybench; @han2024wildguard; @hiddenlayer2025policypuppetry; @hines2024spotlighting; @huang2024bijectionlearning; @hughes2024bestofn; @inie2025summon; @ji2023beavertails; @ji2024pkusaferlhf; @jiang2025sosbench; @jones2025computeruse; @kingma2014adam; @li2024drattack; @li2024mossbench; @li2024saladbench; @li2024wmdp; @lin2023toxicchat; @liu2024flipattack; @liu2024mmsafetybench; @lopez2024pyrit; @luo2024jailbreakv; @lutz2026pyrit; @lv2024codechameleon; @mazeika2023tdc; @mazeika2024harmbench; @mckee2024transparency; @mehrotra2023tap; @microsoft2024skeletonkey; @odin2024; @palaskar2025vlsu; @pfohl2024equitymedqa; @promptfoo2025ccp; @ren2024codeattack; @robustintelligence2024bypass; @roccia2024promptintel; @rottger2023xstest; @rottger2025msts; @russinovich2024crescendo; @russinovich2025cca; @russinovich2025price; @scheuerman2025transphobia; @shaikh2022second; @shayegani2025computeruse; @shen2023donotanything; @sheshadri2024lat; @souly2024strongreject; @stok2023ansi; @tan2026comicjailbreak; @tang2025multilingual; @tedeschi2024alert; @vantaylor2024socialbias; @vidgen2023simplesafetytests; @wang2023decodingtrust; @wang2023donotanswer; @wang2025siuo; @wang2026visualleakbench; @wei2023jailbroken; @xie2024sorrybench; @yu2023gptfuzzer; @yuan2023cipherchat; @zeng2024persuasion; @zeng2024shieldgemma; @zhang2024cbtbench; @ziems2022mic; @zong2024vlguard; @zou2023gcg]

:::
9 changes: 9 additions & 0 deletions doc/references.bib
Original file line number Diff line number Diff line change
Expand Up @@ -719,6 +719,15 @@ @article{lopez2024pyrit
url = {https://arxiv.org/abs/2410.02828},
}

@misc{lutz2026pyrit,
title = {{PyRIT}: Democratizing {AI} Red Teaming Through Open-Source Tooling},
author = {Roman Lutz and Eugenia Kim and Richard Lundeen and Nina Chikanov and Adrian Gavrila and Bolor-Erdene Jagdagdorj and Varun Joginpalli and Toby Kohlenberg and Behnam Ousat and Bashir Partovi and Spencer Schoenberg and Justin Song and Victor Valbuena and Hannah Westra and Pete Bryan and Blake Bullwinkel and Shiven Chawla and Fr{\'e}d{\'e}ric Dubut and Joris de Gruyter and Whitney Maxwell and Amanda Minnich and Shujaat Mirza and Cristian Ovadiuc and Teddy Phillips and Martin Pouliot and Katherine Pratt and Saphir Qi and Giorgio Severi and Elizabeth {Mori Tornheim} and Csenge Varga and Sam Vaughan and Victoria Westerhoff and Ram Shankar {Siva Kumar} and Mark Russinovich and Yonatan Zunger},
year = {2026},
month = sep,
url = {https://commandline.microsoft.com/wp-content/uploads/2026/08/PyRIT_Whitepaper_2026.pdf},
note = {Microsoft Whitepaper},
}

@article{tan2026comicjailbreak,
title = {Structured Visual Narratives Undermine Safety Alignment in Multimodal Large Language Models},
author = {Rui Yang Tan and Yujia Hu and Roy Ka-Wei Lee},
Expand Down