Translation in progress Some entries still include text in the original language.
Oct 12 · Monday
All papers Found 50 papers Another 265 papers do not have category tags yet and are not included in filtered results.
“
About this collection Collection in progress We are building a large AI safety paper collection to help researchers find work related to their interests. Papers are collected automatically andfiltered only for relevance to AI safety , without judging quality, novelty or reading value. The default “Annotated first” shows papers with tags or published paper analyses first. Each group is ordered by original publication date, newest first, with undated papers last. “Newest first” uses publication dates only. This order is not a quality ranking.
One-line summaries, tags and paper analyses are prepared by AI from the papers. Language models may have systematic biases and produce hallucinations.We plan to carry out human annotation and review to reduce errors in this content.
提出 ATLAS 用水平集估计恢复黑盒分类器的对抗输入集合
Published Oct 6
Evaluated models LeNet5 , ResNet50 (CIFAR-10 standard) , ResNet50 (ImageNet standard) and others5 Abstract ATLAS 用主动水平集估计构造黑盒对抗集，作者称其集合比单点攻击更具代表性。ATLAS 是一个查询式 black-box 框架，用来构造诱发失败的对抗输入集合，供鲁棒性审计使用。
提出 Red-TTT，在攻击过程中更新攻击者实现自动化越狱
Published Oct 4
Evaluated models Llama-3-8B-Instruct , gpt-oss-20b , gpt-4.1-mini and others4 提出 CodeMimicry，以结构化代码补全诱导模型生成有害内容
Published Sep 30
Evaluated models GPT-4o , GPT-4.1 , GPT-5-chat and others10 提出 SceneJail，利用视频情境上下文越狱视频多模态模型
Published Sep 30
Evaluated models Qwen2.5-VL-7B-Instruct , Qwen2.5-VL-32B-Instruct , Qwen3-VL-8B-Instruct and others8 提出 FinRT，将消费金融自适应红队轨迹蒸馏为可复用对抗提示生成器
Published Sep 29
Evaluated models Llama-3.3-70B , Llama-3.1-8B , Mixtral-8x7B and others6 Abstract FinRT 用前向失效发现加校准代理 DPO，把消费金融红队收成单次前向生成器。FinRT 是面向消费金融的红队框架：先发现政策失效，再训练一个按政策、领域与目标行为出提示的生成器。
提出 RISE，迭代演化可复用策略对文生图模型做红队
Published Sep 28
Evaluated models DALL·E 3 , Nano Banana 2 , GPT-Image-2 and others7 提出 ENDOPROMPT，以受害者侧伪参考学习降低良性任务效用的前缀
Published Sep 24
Evaluated models Qwen2.5-7B , Llama-3.1-8B , Mistral-7B-v0.3 and others4 Abstract 作者用受害模型续写监督良性效用攻击，并把行为位移、任务退化与请求匹配效果分开评测。ENDOPROMPT 是一种用受害模型自身续写监督前缀生成的 white-box 效用攻击方法。 它针对良性任务失败，不要求产生有害内容或明确拒答。
消融比较方言越狱中表层形式、文化框架与策略库的作用
Published Sep 15
Evaluated models GPT-4o , DeepSeek-Reasoner , DeepSeek-Chat 提出 SAST-IR，用有状态攻击者迭代说服无记忆模型接受反事实
Published Sep 15
Evaluated models DeepSeek-Chat 提出 AdvPIE，在黑盒下搜索表面无害却生成有害图像的提示
Published Sep 5
Evaluated models Stable Diffusion 3.5 Large , FLUX.1-schnell , Safe-StableDiffusion 1.5 and others5 提出 CRACK，用多智能体辩论在黑盒下越狱文生图多层安全过滤
Published Sep 1
Evaluated models Stable Diffusion v1.4 , SDXL , DALL·E 3 and others4 Abstract CRACK 以分层诊断的多智能体辩论搜索多层 T2I 过滤器的联合规避区域。CRACK 是面向文本生成图像模型多层安全栈的黑盒越狱框架，用几何上的 Detection Surface 解释为何粗粒度反馈不够。
提出 MAMJ，在元层面交替优化多模态越狱的策略提示与攻击者权重
Published Aug 27
Evaluated models GPT-4o , Gemini-3-Pro-Preview , Seed 2.0 提出 JailbreakSkill，用可演化技能自动搜索并复用越狱提示
Published Aug 17
Evaluated models GLM 5.2 , DeepSeek-V4-Pro Preview , Llama-3.3-70B-Instruct and others8 提出 ARENA 音频红队框架，自动构造文本安全且音频接地的越狱输入
Published Aug 16
Evaluated models Audio Flamingo 3 , Qwen2-Audio-7B-Instruct , MiMo-Audio-7B-Instruct and others4 提出生物红队模型 Intern-BioBreaker，多轮越狱诱导模型输出可操作生物危害
Published Jul 20
Evaluated models DeepSeek-V3 , Kimi-K2.6 , DeepSeek-V4-Pro and others14 Abstract 论文通过构建专用红队模型评估前沿大模型的生物安全漏洞与物理转化风险。
提出 INFER+ 信息过载方法，越狱大型视觉语言模型
Published Jul 3
Evaluated models Qwen3-VL-8B , Qwen2-VL-7B , InternVL3.5-8B and others8 Abstract 用图文过载越狱 LVLM。这篇工作用信息过载 越狱 LVLM，而不是靠 OOD 变换隐藏意图。
提出 UniAttack 单轮黑盒越狱框架，融合攻击特征绕过多层防御
Published Jun 15
Evaluated models DeepSeek-Chat , DeepSeek-Reasoner , GPT-4.1-Nano and others9 提出 JailbreakOPT，组合原子工具迭代优化黑盒单轮越狱提示
Published Jun 10
Evaluated models Vicuna-13b-v1.5 , LLaMA-3-8b , GPT-4o and others8 提出 AdvGRPO，用 GRPO 闭环共训多轮越狱攻击者与防御者
Published Jun 9
Evaluated models Qwen2.5-7B-Instruct , Qwen2.5-14B-Instruct , Qwen3.5-9B and others7 提出 ASO，用 GRPO 优化视觉风格以放大越狱攻击
Published Jun 1
Evaluated models GPT-4.1-mini , Gemini-2.5-Flash , Qwen3-VL and others6 Abstract 论文揭示了 MLLM 的风格敏感性脆弱面，提出 ASO 框架利用强化学习优化风格触发器，有效放大了现有视觉越狱效果。