Translation in progress Some entries still include text in the original language.
Oct 12 · Monday
All papers Found 40 papers Another 233 papers do not have category tags yet and are not included in filtered results.
“
About this collection Collection in progress We are building a large AI safety paper collection to help researchers find work related to their interests. Papers are collected automatically andfiltered only for relevance to AI safety , without judging quality, novelty or reading value. The default “Annotated first” shows papers with tags or published paper analyses first. Each group is ordered by original publication date, newest first, with undated papers last. “Newest first” uses publication dates only. This order is not a quality ranking.
One-line summaries, tags and paper analyses are prepared by AI from the papers. Language models may have systematic biases and produce hallucinations.We plan to carry out human annotation and review to reduce errors in this content.
Propose KVeil, which adds perturbations to face videos to prevent unauthorized customization from reproducing identity
Published Oct 9
Evaluated models Wan2.2-TI2V-5B , HunyuanVideo-1.5 , Kling 3.0 and others4 Abstract KVeil adapts LETHE's reference-reading disruption to the challenge's two stages, ranking first on the leaderboard in both Final columns.
提出 Safety-Aware Pruning，缓解视觉 token 剪枝放大的多模态越狱
Published Oct 7
Evaluated models LLaVA-1.5-7B Abstract 剪枝去掉背景 token 后注意力塌向恶意前景。这篇工作评估视觉 token 剪枝如何改变 VLM 在多模态越狱下的行为，并给出推理时防御 SAP。
提出 ATLAS 用水平集估计恢复黑盒分类器的对抗输入集合
Published Oct 6
Evaluated models LeNet5 , ResNet50 (CIFAR-10 standard) , ResNet50 (ImageNet standard) and others5 Abstract ATLAS 用主动水平集估计构造黑盒对抗集，作者称其集合比单点攻击更具代表性。ATLAS 是一个查询式 black-box 框架，用来构造诱发失败的对抗输入集合，供鲁棒性审计使用。
提出 imMRAG 攻击，从多模态 RAG 私有图像库提取内容
Published Oct 1
Evaluated models Lumina-mGPT , Gemini 2.5 Flash Image Preview , CLIP ViT-B/16 and others5 提出 SceneJail，利用视频情境上下文越狱视频多模态模型
Published Sep 30
Evaluated models Qwen2.5-VL-7B-Instruct , Qwen2.5-VL-32B-Instruct , Qwen3-VL-8B-Instruct and others8 提出 BoundStyle 与 StyleAT，对抗训练防御人脸识别语义攻击
Published Sep 20
Evaluated models MobileFaceNet (MobileFace) , ResNet (ResNet-152, IR-SE) , RepVGG and others7 Abstract BoundStyle 用 StyleGAN3 有界潜编辑快速攻击 FR。StyleAT 用可调的 StyleGAN3 潜空间攻击 BoundStyle 对人脸识别做对抗训练，以抵抗一般语义编辑，并在评测中面对训练时未见的 DiffPrivate。
提出扩散潜空间地理扰动防御，抑制视觉语言模型泄露精确地理位置
Published Sep 18
Evaluated models GPT-4.1 , GPT-5 , Gemini 2.5 Pro and others5 复现 Tree-Ring 语义水印的黑盒伪造并恢复检测统计量
Published Sep 11
Evaluated models Stable Diffusion XL base 1.0 提出黑盒攻击 DRIFT，偏转生成轨迹以去除扩散水印
Published Sep 8 提出 DIVA，将有害意图拆成视觉锚点与运动文本以越狱视频生成模型
Published Sep 7
Evaluated models Wan , CogVideoX , LTX-Video and others9 Abstract DIVA 用视觉锚点抑制语义漂移做视频越狱，并给出多条件安全基准 TI2VSafetyBench。DIVA 是针对带参考图的视频生成模型的免训练 black-box 越狱：用一致性机制本身堵住语义漂移这条安全逃逸路径。 。
提出 MAMJ，在元层面交替优化多模态越狱的策略提示与攻击者权重
Published Aug 27
Evaluated models GPT-4o , Gemini-3-Pro-Preview , Seed 2.0 提出 ARENA 音频红队框架，自动构造文本安全且音频接地的越狱输入
Published Aug 16
Evaluated models Audio Flamingo 3 , Qwen2-Audio-7B-Instruct , MiMo-Audio-7B-Instruct and others4 提出 SPARED，用对抗编辑数据训练基于推理的 AI 生成图像检测器
Published Aug 13
Evaluated models Qwen3.5-9B Abstract SPARED 用防捷径的编辑对抗环训练 9B 推理检测器。SPARED 是一套用于可解释 AI 生成图像检测的攻防强化学习流程，报告模型是 Qwen3.5-9B 上的第三轮防御器。
提出 INFER+ 信息过载方法，越狱大型视觉语言模型
Published Jul 3
Evaluated models Qwen3-VL-8B , Qwen2-VL-7B , InternVL3.5-8B and others8 Abstract 用图文过载越狱 LVLM。这篇工作用信息过载 越狱 LVLM，而不是靠 OOD 变换隐藏意图。
提出 DSR 跨模态越狱，用无害图文诱导 MLLM 生成有害图像
Published Jun 1
Evaluated models gemini-2.5-flash-image , qwen-image-2.0 , Tongyi Wanx 2.5 Abstract DSR 用无害图文诱导商业 MLLM 输出有害图像，作者称组合能力会反过来扩大攻击面。DSR 是一种 black-box 跨模态越狱：输入侧不放显式有害内容，而让商业 MLLM 在推理中把无害图文重组成有害图像。
提出 FRA-Attack，用频域对齐与梯度正则做可迁移定向视觉攻击
Published May 20
Evaluated models GPT-5.2 , GPT-5.4 , Claude-Opus-4.6 and others15 Abstract FRA-Attack 以频域对齐和梯度低通做可迁移定向攻击，闭源面板上作者称整体更强，Gemma 除外。FRA-Attack 是面向闭源 MLLM 的迁移式定向图像攻击。作者要解决的是：空间域局部对齐重复全局低频，代理梯度的高频成分又把更新拉向代理自身。
提出声学干扰攻击 AIA，用良性音频潜语义越狱音频语言模型
Published May 18
Evaluated models Qwen3-Omni , Qwen2.5-Omni , Qwen2-Audio and others10 提出多图越狱框架 DMN，把有害意图拆进图像序列绕过安全护栏
Published May 18
Evaluated models GPT-4V , GPT-4o , GPT-5 and others10 提出 GPO-V，用全局概率优化的视觉扰动越狱扩散视觉语言模型
Published May 8
Evaluated models LLaDA-V , LaViDA Abstract 作者用视觉扰动改 dVLM 的全局生成概率，以绕过两类拒绝。GPO-V 把越狱从“开头必须顺从”改成“整段去噪概率朝肯定方向走”。 。
提出删字变体越狱方法，利用重构与隐藏权衡绕过多模态模型安全过滤
Published May 7
Evaluated models GPT-5.4-nano , GPT-5.4-mini , Gemini-2.5-Flash and others19