Translation in progress Some entries still include text in the original language.
Oct 12 · Monday
Another 265 papers do not have category tags yet and are not included in filtered results.
“
About this collection Collection in progress We are building a large AI safety paper collection to help researchers find work related to their interests. Papers are collected automatically andfiltered only for relevance to AI safety , without judging quality, novelty or reading value. The default “Annotated first” shows papers with tags or published paper analyses first. Each group is ordered by original publication date, newest first, with undated papers last. “Newest first” uses publication dates only. This order is not a quality ranking.
One-line summaries, tags and paper analyses are prepared by AI from the papers. Language models may have systematic biases and produce hallucinations.We plan to carry out human annotation and review to reduce errors in this content.
提出 DIVA，将有害意图拆成视觉锚点与运动文本以越狱视频生成模型
Published Sep 7
Evaluated models Wan , CogVideoX , LTX-Video and others9 Abstract DIVA 用视觉锚点抑制语义漂移做视频越狱，并给出多条件安全基准 TI2VSafetyBench。DIVA 是针对带参考图的视频生成模型的免训练 black-box 越狱：用一致性机制本身堵住语义漂移这条安全逃逸路径。 。
提出 DSR 跨模态越狱，用无害图文诱导 MLLM 生成有害图像
Published Jun 1
Evaluated models gemini-2.5-flash-image , qwen-image-2.0 , Tongyi Wanx 2.5 Abstract DSR 用无害图文诱导商业 MLLM 输出有害图像，作者称组合能力会反过来扩大攻击面。DSR 是一种 black-box 跨模态越狱：输入侧不放显式有害内容，而让商业 MLLM 在推理中把无害图文重组成有害图像。
提出多图越狱框架 DMN，把有害意图拆进图像序列绕过安全护栏
Published May 18
Evaluated models GPT-4V , GPT-4o , GPT-5 and others10 提出删字变体越狱方法，利用重构与隐藏权衡绕过多模态模型安全过滤
Published May 7
Evaluated models GPT-5.4-nano , GPT-5.4-mini , Gemini-2.5-Flash and others19 提出 StructAttack，用结构图把无害语义槽诱导视觉模型拼成恶意内容
Published Mar 8
Evaluated models GPT-4o (1120) , Gemini-2.0-Flash (001) , Gemini-2.5-Flash and others6 Abstract StructAttack 把有害查询拆成无害槽并画进结构图，在黑盒单次查询下诱导 LVLM 填出有害内容。StructAttack 是针对 LVLM 的黑盒、单次查询越狱：把有害指令拆成单独看似无害的槽，画进结构图，再让模型把槽拼回有害内容。 。
提出 COMET 跨模态纠缠攻击，越狱视觉语言模型
Published Feb 10
Evaluated models GPT-4.1 , GPT-4.1-mini , Gemini-2.5-Flash and others9 Abstract COMET 做黑盒跨模态纠缠越狱。COMET 是面向具备多模态推理的 VLM 的黑盒越狱，用来红队测试跨模态安全对齐。作者要处理的缺口是：把恶意线索分到图文的固定组合，测不到多步推理里才出现的漏洞。攻击不访问梯度，只构造图文输入。
提出 Text-DJ，用拆分文本图网格越狱视觉语言模型
Published Jan 31
Evaluated models Qwen/Qwen3-VL-4B-Instruct , Qwen/Qwen3-VL-8B-Instruct , Qwen/Qwen3-VL-30B-A3B-Instruct and others6 Attacks arXiv 2512.20168 · Dec 23, 2025 提出双重隐写越狱 Odysseus，用图像隐写绕过多模态系统安全过滤器
Published Dec 23, 2025
Evaluated models GPT-4o-2024-08-06 , Gemini-2.0-pro , Gemini-2.0-flash and others4 Attacks arXiv 2504.01094 · Apr 2, 2025 提出 MULTI-AUDIOJAIL，以多语多口音和声学扰动越狱音频模型
Published Apr 2, 2025
Evaluated models Qwen2-Audio , DiVA-llama-3-v0-8b , MERaLiON-AudioLLM-Whisper-SEA-LION and others5 Abstract 黑盒多语多口音音频加声学扰动可抬高 LALM 的 JSR，文本示范防御并非在每个模型上都下降。
You have reached the end