Translation in progress Some entries still include text in the original language.
Oct 12 · Monday
Another 261 papers do not have category tags yet and are not included in filtered results.
“
About this collection Collection in progress We are building a large AI safety paper collection to help researchers find work related to their interests. Papers are collected automatically andfiltered only for relevance to AI safety , without judging quality, novelty or reading value. The default “Annotated first” shows papers with tags or published paper analyses first. Each group is ordered by original publication date, newest first, with undated papers last. “Newest first” uses publication dates only. This order is not a quality ranking.
One-line summaries, tags and paper analyses are prepared by AI from the papers. Language models may have systematic biases and produce hallucinations.We plan to carry out human annotation and review to reduce errors in this content.
提出 ZoneClaw,用记忆分区防御计算机使用 Agent 的持久记忆攻击
Published Oct 1
Evaluated models Claude Sonnet 4.6 , GPT-5.5 , GLM-5.2 and others4 用 FARSIGHT 方案级评测金融 LLM 交易 Agent 的稳健性与安全失败
Published Sep 17
Evaluated models ChatGPT Deep Research 提出类型化溯源与断言护栏,约束持久 Agent 释放自传断言
Published Sep 2 系统研究 LLM 智能体记忆投毒并构建基准 MPBench
Published Jun 3
Evaluated models Meta-Llama-3.1-70B-Instruct , Deberta-v3-base , Llama-3.1-8B-Instruct and others5 Abstract 系统研究了智能体记忆投毒风险,揭示了写入渠道漏洞,构建了 MPBench 基准并指出提示注入防御的局限。
提出潜伏记忆投毒,诱导 Agent 把外部文档写成持久伪造记忆
Published May 15
Evaluated models GPT-5.4 , GPT-5.5 , Claude Sonnet 4.6 and others12 Abstract 持久记忆成为跨会话攻击面:通用载荷可写入伪造记忆,并在相关后续任务中影响行为。sleeper memory poisoning 研究带持久记忆的 LLM 助手:外部文档能否让助手存下一则伪造的用户记忆,并在原文档消失后的新会话里被取回、用来改变回复或动作。
提出 eTAMP,用网页内容跨会话投毒 Web Agent 轨迹记忆并诱导越权操作
Published Apr
Evaluated models GPT-5-mini , GPT-5.2 , GPT-OSS-120B and others6 Abstract 论文提出了基于环境注入的跨任务记忆投毒攻击 eTAMP,作者报告智能体在环境压力下易感性增加且能力与安全并不协同。该论文评估了基于大语言模型的 Web 智能体在利用历史交互轨迹进行记忆增强时的安全脆弱性。
梳理自主 Agent 威胁并提出全生命周期防御蓝图 FASA
Published Mar 13 Abstract 以 OpenClaw 为例划分三层风险,并用 FASA 描述从输入到系统执行的防御。这是一份以 OpenClaw 为案例的威胁梳理和防御架构报告,不是带分数的攻击或防御评测。
提出对齐五阶段的纵深防御,缓解自主 Agent 跨阶段威胁
Published Mar 12 Abstract 这是对 OpenClaw 的生命周期威胁分析与分层缓解设计,案例为定性证据。这是对 OpenClaw 的生命周期威胁分析,并配套一套分层缓解设计。要处理的问题是:自主智能体把即时通讯、持久记忆、第三方插件和高权限执行连在一起之后,攻击不再限于单轮越狱,而会跨初始化到执行的多个阶段复合。作者认为只加固单个接口的防御,挡不住这种跨时间攻击。
You have reached the end