Translation in progress Some entries still include text in the original language.
Oct 13 · Tuesday
All papers Found 14 papers Another 203 papers do not have category tags yet and are not included in filtered results.
“
About this collection Collection in progress We are building a large AI safety paper collection to help researchers find work related to their interests. Papers are collected automatically andfiltered only for relevance to AI safety , without judging quality, novelty or reading value. The default “Annotated first” shows papers with tags or published paper analyses first. Each group is ordered by original publication date, newest first, with undated papers last. “Newest first” uses publication dates only. This order is not a quality ranking.
One-line summaries, tags and paper analyses are prepared by AI from the papers. Language models may have systematic biases and produce hallucinations.We plan to carry out human annotation and review to reduce errors in this content.
提出 WebMirage，用局部对抗图像劫持视觉网页 Agent 的浏览器操作
Published Oct 7
Evaluated models LLaVA-v1.5-13B , LLaVA-v1.6-34B , MiniCPM-o-8B and others6 Abstract 论文提出了针对网络智能体的端到端视觉红队框架 WebMirage，揭示了从视觉定位到浏览器执行的安全脆弱性。WebMirage 是一个面向视觉定位网络智能体的流水线感知端到端红队攻击框架。
提出 CredLeak-Bench，评测 Agent 面对钓鱼的凭据泄露与恢复
Published Oct 6
Evaluated models Claude Sonnet 5 , Claude Opus 4.8 , Gemini 3.6 Flash and others7 提出 MADBench，评测多智能体辩论是吸收还是放大对抗影响
Published Sep 30
Evaluated models gpt-4o , GPT-5 , GPT-6 Astra Abstract MADBench 显示辩论能吸收部分准确率攻击，同时放大未授权读写。MADBench 是一个评测多智能体辩论安全性的基准，用来看攻击是被辩论吸收还是被放大。
提出 VirusCascade，联合操纵商品描述与交互轨迹以劫持推荐智能体协同反思
Published Sep 29
Evaluated models AgentCF , AgentSEQ , AgentRAG and others4 Abstract 作者把反思写回视为推广攻击入口，并用联合操纵和诊断探针研究其持续与传播。VirusCascade 是针对推荐智能体协作反思的 black-box targeted promotion 攻击研究。 攻击者只改商品描述和少量账号的普通交互，试图让目标商品获得更多良性用户曝光。
提出双控多智能体基准 DUMA-Bench，测量对抗环境下的策略违反
Published Sep 21
Evaluated models GPT-5 , GPT-5-mini , GPT-5-nano and others14 Abstract DUMA-Bench 用双控交互评测智能体安全。DUMA-Bench 把 τ²-bench 的双控交互做成智能体安全评测，用来看策略违反如何随用户、模型和环境一起出现。
提出多智能体系统提示注入的威胁模型与四层架构防御
Published Sep 19
Evaluated models GPT-4o (2024-08-06) , Claude 3.5 Sonnet , Llama 3 70B-Instruct 提出 Emergence World，对长时程多智能体系统开展对抗压力测试
Published Sep 15
Evaluated models Claude Opus 4.8 , DeepSeek v4 Pro , Gemini 3.5 Flash and others9 Abstract 作者通过长期平行世界实验指出模型对齐不具备可组合性，单模型群体会产生社会奉承、协同退缩及语言不透明等失效。
提出 WebTrap 三阶段陷阱，中途劫持浏览器 Agent 完成攻击后再返回用户任务
Published May 8
Evaluated models DeepSeek-V3.1-Terminus , Gemini-2.5-Flash , GLM-4.5-Air and others5 Abstract WebTrap 把攻击目标嵌进用户流程中途执行再返回。WebTrap 是针对长程网页与文件导航的中途劫持注入，目标是在完成攻击动作后仍回到用户任务。
Conduct adversarial attacks on product images for open-source visual shopping agents and induce wrong purchases
Published Mar 17
Evaluated models LLaVA-v1.5-7B , Qwen2.5-VL-7B Abstract The authors state that LLaVA is easily induced by three attacks to buy the wrong item, while Qwen's correct purchase rate remains close to its clean condition.The authors compare the robustness of two open-source VLM shopping agents against image adversarial perturbations in a self-built e-commerce environment.
Proposing a lineage-graph governance layer to suppress error cascades in multi-agent collaboration
Published Mar 4 Abstract A single seed can solidify into a false consensus along a fixed collaboration graph.The authors turn "small errors becoming collective false consensus" in LLM-MAS into a measurable propagation on a graph, and use a plug-in that only changes messages, not topology, to reduce the final infection.
提出 AgentLeak 基准，测量多智能体内部通道隐私泄露
Published Feb 12
Evaluated models GPT-4o , GPT-4o-mini , Claude-3.5-Sonnet and others5 构建 TRAP 基准，评测网页 Agent 被界面提示注入劫持任务的情况
Published Dec 29, 2025
Evaluated models GPT-5 , Claude Sonnet 3.7 , Gemini 2.5 Flash and others6 Abstract 论文提出了基于五维模块化攻击空间的 TRAP 基准，评估了六个模型在真实网页环境中的注入风险。研究定位 ：针对网页自主智能体易受外部界面提示注入攻击的问题，构建了基于真实网站克隆的模块化评测基准 TRAP。
提出 WAInjectBench 评测网页 Agent 的提示注入检测
Published Oct 2, 2025
Evaluated models GPT-4o , Mistral-7B-Instruct-v0.1 , Llama-Prompt-Guard-2-86M and others8 Abstract WAInjectBench 比较网页智能体的提示注入检测：显式线索可被部分检出，隐蔽攻击大多漏检。WAInjectBench 是网页智能体提示注入检测的基准。作者要看现有检测器能否发现这类攻击：攻击者改网页，使智能体执行目标动作，而不是用户任务。作者称这是首个此类综合基准。
Attacks arXiv 2406.12814 · Jun 19, 2024 提出 ARE 框架与图像文本攻击，评测多模态网页 Agent 的对抗鲁棒性
Published Jun 19, 2024
Evaluated models GPT-4o , GPT-4V , Claude-3-Opus and others4 Abstract 系统评估多模态网页智能体的脆弱性，指出推理时计算组件被攻破会加剧系统风险。
You have reached the end