Translation in progress Some entries still include text in the original language.
Oct 12 · Monday
All papers Found 11 papers Another 240 papers do not have category tags yet and are not included in filtered results.
“
About this collection Collection in progress We are building a large AI safety paper collection to help researchers find work related to their interests. Papers are collected automatically andfiltered only for relevance to AI safety , without judging quality, novelty or reading value. The default “Annotated first” shows papers with tags or published paper analyses first. Each group is ordered by original publication date, newest first, with undated papers last. “Newest first” uses publication dates only. This order is not a quality ranking.
One-line summaries, tags and paper analyses are prepared by AI from the papers. Language models may have systematic biases and produce hallucinations.We plan to carry out human annotation and review to reduce errors in this content.
提出 WebMirage,用局部对抗图像劫持视觉网页 Agent 的浏览器操作
Published Oct 7
Evaluated models LLaVA-v1.5-13B , LLaVA-v1.6-34B , MiniCPM-o-8B and others6 Abstract 论文提出了针对网络智能体的端到端视觉红队框架 WebMirage,揭示了从视觉定位到浏览器执行的安全脆弱性。WebMirage 是一个面向视觉定位网络智能体的流水线感知端到端红队攻击框架。
提出 imMRAG 攻击,从多模态 RAG 私有图像库提取内容
Published Oct 1
Evaluated models Lumina-mGPT , Gemini 2.5 Flash Image Preview , CLIP ViT-B/16 and others5 提出 MMSkillRisk 基准,评测多模态技能图像中的隐藏指令诱导 Agent 越权操作
Published Sep 28
Evaluated models GPT-5.6-sol , Kimi-K2.6 , Kimi-K3 and others6 Abstract 论文提出 MMSkillRisk 基准与 NCVA 攻击,揭示多模态技能中教学图像潜藏指令可引发未授权操作并与良性任务共存。
用 MMPIBench 评测多模态提示注入对 Agent 框架的影响
Published Sep 9
Evaluated models Claude Opus 4.8 , GPT-5.4 , Gemini 3.1 Pro and others6 Abstract 论文提出 MMPIBench 评测多模态提示注入对智能体的影响,发现模型主导行为、尝试远超完成,音频通道缺乏防护。
提出 Repeat-After-Me 自适应视觉提示注入,诱导 VLM 智能体执行指定任务
Published Sep 4
Evaluated models Claude-Opus-4.7 , GPT-5.5 , Gemini-3.1-Pro and others6 Abstract 论文提出了针对黑盒 VLM 的前缀诱导自适应视觉提示注入,在多款模型上诱发了工具调用与隐私泄露。
提出 PaperGuard,用图文注入与梯度扰动抬高自动审稿分数并检测恶意指令
Published Jun 11
Evaluated models Claude-sonnet-4.5 , GPT-4o , GPT-4.1 and others11 Abstract PaperGuard 测到提示注入与白盒视觉抬分,并比较分块检索防御。PaperGuard 同时评测并检测多模态 AI 审稿中的评分操纵。
Conduct adversarial attacks on product images for open-source visual shopping agents and induce wrong purchases
Published Mar 17
Evaluated models LLaVA-v1.5-7B , Qwen2.5-VL-7B Abstract The authors state that LLaVA is easily induced by three attacks to buy the wrong item, while Qwen's correct purchase rate remains close to its clean condition.The authors compare the robustness of two open-source VLM shopping agents against image adversarial perturbations in a self-built e-commerce environment.
提出 SWhisper,用近超声波向语音驱动 LLM 隐蔽注入越狱提示
Published Mar 14
Evaluated models Meta-Llama-3.1-8B-Instruct , Gemma-3-4B , Qwen2.5-7B-Instruct and others9 Attacks arXiv 2512.20168 · Dec 23, 2025 提出双重隐写越狱 Odysseus,用图像隐写绕过多模态系统安全过滤器
Published Dec 23, 2025
Evaluated models GPT-4o-2024-08-06 , Gemini-2.0-pro , Gemini-2.0-flash and others4 Attacks arXiv 2505.23266 · May 29, 2025 提出 AdvOF,生成对抗物体误导视觉语言导航智能体的场景感知
Published May 29, 2025
Evaluated models Lseg , Clip , ViT-L/16 and others5 Abstract AdvOF 以多视角融合生成对抗物体。AdvOF 是针对 VLM 驱动 VLN 服务导航的对抗物体攻击。
Attacks arXiv 2406.12814 · Jun 19, 2024 提出 ARE 框架与图像文本攻击,评测多模态网页 Agent 的对抗鲁棒性
Published Jun 19, 2024
Evaluated models GPT-4o , GPT-4V , Claude-3-Opus and others4 Abstract 系统评估多模态网页智能体的脆弱性,指出推理时计算组件被攻破会加剧系统风险。
You have reached the end