Translation in progress Some entries still include text in the original language.
Oct 13 · Tuesday
All papers Found 25 papers Another 203 papers do not have category tags yet and are not included in filtered results.
“
About this collection Collection in progress We are building a large AI safety paper collection to help researchers find work related to their interests. Papers are collected automatically andfiltered only for relevance to AI safety , without judging quality, novelty or reading value. The default “Annotated first” shows papers with tags or published paper analyses first. Each group is ordered by original publication date, newest first, with undated papers last. “Newest first” uses publication dates only. This order is not a quality ranking.
One-line summaries, tags and paper analyses are prepared by AI from the papers. Language models may have systematic biases and produce hallucinations.We plan to carry out human annotation and review to reduce errors in this content.
提出 WebMirage,用局部对抗图像劫持视觉网页 Agent 的浏览器操作
Published Oct 7
Evaluated models LLaVA-v1.5-13B , LLaVA-v1.6-34B , MiniCPM-o-8B and others6 Abstract 论文提出了针对网络智能体的端到端视觉红队框架 WebMirage,揭示了从视觉定位到浏览器执行的安全脆弱性。WebMirage 是一个面向视觉定位网络智能体的流水线感知端到端红队攻击框架。
提出校准重合成方法,以生成器反演保真度认证真实图像并防御对抗扰动
Published Oct 5 Abstract 论文提出基于反演保真度与阈值校准的健全认证框架,在对抗扰动下维持错误率界限,并指出真实内容可认证性随生成器演进而萎缩。
提出 Kubernetes 运维智能体的七层纵深防御框架与参考架构
Published Oct 2 Abstract 把运维智能体当不可信租户,用七层控制在完全攻破假设下约束行动。把 Kubernetes 上的运维智能体当作不可信租户,在假定提示注入已完全控制其工具选择的前提下,用基础设施重建数据面与控制面的边界。要解决的是:智能体读日志、注解、工单或 MCP 工具描述时,这些内容可以变成它带着自身凭据执行的命令。模型对齐和分类器只降低概率。
构建 EvoRiskBench 评测工作区 Agent 的运行时安全风险
Published Oct 2
Evaluated models GPT-5.6 Sol , DeepSeek-V4-Pro-0813 , Claude Opus 5 Abstract 论文构建了工作空间智能体运行时风险基准 EvoRiskBench,发现高执行力智能体在 IPI 下面临较高安全风险。
提出 imMRAG 攻击,从多模态 RAG 私有图像库提取内容
Published Oct 1
Evaluated models Lumina-mGPT , Gemini 2.5 Flash Image Preview , CLIP ViT-B/16 and others5 提出 RECAST,本地改写图表与语音并做可逆数值映射以保护远程推理隐私
Published Oct 1 用 DIBench 评测移动 GUI 智能体被 UI 注入后的决策完整性
Published Sep 29
Evaluated models Qwen2.5-VL(32B) , Qwen3-VL(32B) , GUI-Owl(32B) and others7 Abstract 论文提出移动智能体决策完整性基准 DIBench,发现欺诈 UI 注入诱导目标选择并推高完成率,通用防御收益不稳定。
提出 MMSkillRisk 基准,评测多模态技能图像中的隐藏指令诱导 Agent 越权操作
Published Sep 28
Evaluated models GPT-5.6-sol , Kimi-K2.6 , Kimi-K3 and others6 Abstract 论文提出 MMSkillRisk 基准与 NCVA 攻击,揭示多模态技能中教学图像潜藏指令可引发未授权操作并与良性任务共存。
提出 PMPA,经外部源向 Agent 持久记忆投毒并跨会话泄露隐私
Published Sep 12
Evaluated models DeepSeek-V4-Flash , DeepSeek-V4-Pro , Qwen3-Max Abstract 论文提出了持久记忆投毒攻击 PMPA,报告了 harness 智能体在处理外部数据时易受跨会话记忆投毒与隐私泄露的风险。
用 MMPIBench 评测多模态提示注入对 Agent 框架的影响
Published Sep 9
Evaluated models Claude Opus 4.8 , GPT-5.4 , Gemini 3.1 Pro and others6 Abstract 论文提出 MMPIBench 评测多模态提示注入对智能体的影响,发现模型主导行为、尝试远超完成,音频通道缺乏防护。
提出 Repeat-After-Me 自适应视觉提示注入,诱导 VLM 智能体执行指定任务
Published Sep 4
Evaluated models Claude-Opus-4.7 , GPT-5.5 , Gemini-3.1-Pro and others6 Abstract 论文提出了针对黑盒 VLM 的前缀诱导自适应视觉提示注入,在多款模型上诱发了工具调用与隐私泄露。
提出 Mind2Web-Injection 评测网页 Agent 视觉注入护栏
Published Sep 2
Evaluated models GPT-5.6-luna , Qwen3-VL-32B , Qwen3-VL-8B and others6 Abstract 作者称检测、定位和反事实响应在六个 VLM 上可分开。Mind2Web-Injection 用来检查网页截图护栏的判决是否对齐到该用的画面证据。 。
提出针对 Agent Harness 的上下文特权提升攻击
Published Sep 1
Evaluated models GPT-5.5 , GPT-5.4 mini , Claude-Sonnet-4.6 and others7 提出 AgentKernel,用四支柱强制中介 Agent 的输入、工具与记忆
Published Aug 29 Abstract AgentKernel 是四支柱智能体 OS 设计,安全论证未附带实测数字。AgentKernel 是把安全做成组织原则的智能体 OS 架构,不是带跑分的攻防评测。
提出 PaperGuard,用图文注入与梯度扰动抬高自动审稿分数并检测恶意指令
Published Jun 11
Evaluated models Claude-sonnet-4.5 , GPT-4o , GPT-4.1 and others11 Abstract PaperGuard 测到提示注入与白盒视觉抬分,并比较分块检索防御。PaperGuard 同时评测并检测多模态 AI 审稿中的评分操纵。
提出 DEEPTRAP 以搜索可诱导不安全轨迹的执行上下文载荷
Published May 11
Evaluated models GPT-5.4 , Claude Sonnet 4.6 , GLM-5 and others9 Abstract DEEPTRAP 用轨迹级搜索发现 OpenClaw 上下文风险,作者称不能只看最终回复。DEEPTRAP 是针对 OpenClaw 的自动化红队框架,搜索执行前被改写的文件、记忆、技能、工具元数据或配置,而不是改用户指令。
Conduct adversarial attacks on product images for open-source visual shopping agents and induce wrong purchases
Published Mar 17
Evaluated models LLaVA-v1.5-7B , Qwen2.5-VL-7B Abstract The authors state that LLaVA is easily induced by three attacks to buy the wrong item, while Qwen's correct purchase rate remains close to its clean condition.The authors compare the robustness of two open-source VLM shopping agents against image adversarial perturbations in a self-built e-commerce environment.
Proposes out-of-process dual-channel comparison classification to intercept erroneous clicks by computer-use agents
Published Mar 16
Evaluated models multi-modal-embed-small Abstract Perception errors can be exploited by swapping screen pixels.The authors frame CUA's perception failure as a security vulnerability, visual confused deputy : the agent authorizes click(x,y) based on a misread screen, and the actual landing point differs from the element it believes it is clicking.
提出 SWhisper,用近超声波向语音驱动 LLM 隐蔽注入越狱提示
Published Mar 14
Evaluated models Meta-Llama-3.1-8B-Instruct , Gemma-3-4B , Qwen2.5-7B-Instruct and others9 提出 RA-Det,利用鲁棒性不对称检测 AI 生成图像
Published Mar 2 Abstract RA-Det 把扰动下特征漂移差变成检测信号,平均 ACC 高于表中通用检测器,但不是每行最高。RA-Det 是合成图像检测器,用扰动下的表示稳定性差异代替外观痕迹。