Supplementary Material Dataset and Lessons Learned from the 2024 SaTML LLM Capture-the-Flag Competition

The Croissant Akhtar et al. (2024) metadata can be found at https://huggingface.co/api/ We present the data card, following the format proposed by Pushkarna et al. (2022). "By using this chat interface and the API, you accept that the interactions with the interface and the API can be used for research purposes, and potentially open-sourced by the competition organizers." The dataset is divided into two splits: defenses and chats. For more details, see Section 4 in the main paper. See Figure 1 for an example.