Translation in progress Some entries still include text in the original language.
Oct 12 · Monday
Another 305 papers do not have category tags yet and are not included in filtered results.
“
About this collection Collection in progress We are building a large AI safety paper collection to help researchers find work related to their interests. Papers are collected automatically andfiltered only for relevance to AI safety , without judging quality, novelty or reading value. The default “Annotated first” shows papers with tags or published paper analyses first. Each group is ordered by original publication date, newest first, with undated papers last. “Newest first” uses publication dates only. This order is not a quality ranking.
One-line summaries, tags and paper analyses are prepared by AI from the papers. Language models may have systematic biases and produce hallucinations.We plan to carry out human annotation and review to reduce errors in this content.
重测并扩展对 AI Agent 的提示注入,并用 Agent Card 欺骗操纵 A2A 选择
Published Oct 8
Evaluated models Ollama Mistral 0.9.5 , llama3-8b-8192 , gemini-2.0-flash-lite and others5 Abstract 单智能体过滤与分类可被格式或措辞绕过,A2A 选卡还会偏向名称和描述。作者在自建的 LangChain、AutoGen 和 A2A 系统上重测提示注入,并改 Agent Card 看选择是否偏移。摘要称试验主要凸显单智能体弱点,同时把攻击扩到多智能体。
提出 APEX,在执行边界用授权契约防御 Agent 间接提示注入
Published Oct 4
Evaluated models DeepSeek-V4-Flash , GLM-5.2 , GPT-5.6-sol 提出 COBRA 双 LLM 架构,防御计算机使用 Agent 的分支转向攻击
Published Oct 2
Evaluated models gpt-5 , UI-TARS-1.5-7B , claude-sonnet-5 and others6 Abstract 提出分支转向防御架构 COBRA,通过事前能力约束与边界代理消除分支转向攻击并兼顾效用。
构建 ACE 语料,评测内核级证据对 Agent 攻击检测的有效性
Published Sep 24
Evaluated models AdaBoost , XGBoost , TabPFN and others10 Abstract ACE 用配对的内核与应用层证据表明,syscall 痕迹可判别智能体攻击,两层组合通常更好。ACE 是一份把智能体会话的内核 syscall 痕迹与应用层清单、转录配对起来的检测语料和基准。 。
提出 ClawSafety,评测个人智能体读到对抗工件后是否执行有害动作
Published Apr 2
Evaluated models Claude Sonnet 4.6 , GPT-5.1 , Gemini 2.5 Pro and others5 梳理自主 Agent 威胁并提出全生命周期防御蓝图 FASA
Published Mar 13 Abstract 以 OpenClaw 为例划分三层风险,并用 FASA 描述从输入到系统执行的防御。这是一份以 OpenClaw 为案例的威胁梳理和防御架构报告,不是带分数的攻击或防御评测。
提出对齐五阶段的纵深防御,缓解自主 Agent 跨阶段威胁
Published Mar 12 Abstract 这是对 OpenClaw 的生命周期威胁分析与分层缓解设计,案例为定性证据。这是对 OpenClaw 的生命周期威胁分析,并配套一套分层缓解设计。要处理的问题是:自主智能体把即时通讯、持久记忆、第三方插件和高权限执行连在一起之后,攻击不再限于单轮越狱,而会跨初始化到执行的多个阶段复合。作者认为只加固单个接口的防御,挡不住这种跨时间攻击。
You have reached the end