Translation in progress Some entries still include text in the original language.
Oct 12 · Monday
Another 265 papers do not have category tags yet and are not included in filtered results.
“
About this collection Collection in progress We are building a large AI safety paper collection to help researchers find work related to their interests. Papers are collected automatically andfiltered only for relevance to AI safety , without judging quality, novelty or reading value. The default “Annotated first” shows papers with tags or published paper analyses first. Each group is ordered by original publication date, newest first, with undated papers last. “Newest first” uses publication dates only. This order is not a quality ranking.
One-line summaries, tags and paper analyses are prepared by AI from the papers. Language models may have systematic biases and produce hallucinations.We plan to carry out human annotation and review to reduce errors in this content.
提出 MAMJ,在元层面交替优化多模态越狱的策略提示与攻击者权重
Published Aug 27
Evaluated models GPT-4o , Gemini-3-Pro-Preview , Seed 2.0 提出 INFER+ 信息过载方法,越狱大型视觉语言模型
Published Jul 3
Evaluated models Qwen3-VL-8B , Qwen2-VL-7B , InternVL3.5-8B and others8 Abstract 用图文过载越狱 LVLM。这篇工作用信息过载 越狱 LVLM,而不是靠 OOD 变换隐藏意图。
提出 ASO,用 GRPO 优化视觉风格以放大越狱攻击
Published Jun 1
Evaluated models GPT-4.1-mini , Gemini-2.5-Flash , Qwen3-VL and others6 Abstract 论文揭示了 MLLM 的风格敏感性脆弱面,提出 ASO 框架利用强化学习优化风格触发器,有效放大了现有视觉越狱效果。
提出 VROP,把有害意图拆成良性视觉 gadget 越狱视觉语言模型
Published Mar 10
Evaluated models GPT-4o , Claude 3.7 Sonnet , GLM-4V-Plus and others7 Abstract VROP 以良性视觉 gadget 与控制流提示词做组合越狱。VROP 是 black-box 多模态越狱框架:不在输入中放显式恶意触发,而把有害目标拆成语义正交的良性视觉 gadget,再用控制流提示词把合成留到后期推理。
提出 FERRET 框架,用扩展生成多轮多模态越狱对话
Published Feb 18
Evaluated models Llama Maverick , Claude Haiku , GPT-4o 提出 MM-Plan 多模态越狱框架,自动规划多轮图像编辑以越狱视觉独占目标
Published Feb 5
Evaluated models Llama-3.2-11B , InternVL3-8B , Qwen3-VL-8B and others8 Abstract 作者称全局规划能攻破对单轮攻击更稳的前沿 MLLM。MM-Plan 是面向 Visual Exclusivity 的 black-box 多模态红队方法,并配有人工基准 VE-Safety。
提出 ReAct 双策略,按反馈改写提示并扰动图像绕过 VLM 安全过滤
Published Jan 30
Evaluated models Gemini-2.0-Flash Attacks arXiv 2503.06223 · Mar 8, 2025 提出 RedDiff,用强化扩散生成图像审计 VLM 情境安全失效
Published Mar 8, 2025
Evaluated models LLaVA-1.5-7B , Gemini-1.5-flash , LLaMA-3.2-11B-Vision-Instruct Abstract 用强化扩散生成视觉上下文,审计有害文本情境下的 VLM 安全失效。RedDiffuser 是黑盒审计框架:有害内容不是显式攻击指令,而是固定的部分有毒文本,再配上扩散模型生成的图像,看 VLM 的开放续写会不会变得不安全。
You have reached the end