Translation in progress Some entries still include text in the original language.
Oct 12 · Monday
Another 240 papers do not have category tags yet and are not included in filtered results.
“
About this collection Collection in progress We are building a large AI safety paper collection to help researchers find work related to their interests. Papers are collected automatically andfiltered only for relevance to AI safety , without judging quality, novelty or reading value. The default “Annotated first” shows papers with tags or published paper analyses first. Each group is ordered by original publication date, newest first, with undated papers last. “Newest first” uses publication dates only. This order is not a quality ranking.
One-line summaries, tags and paper analyses are prepared by AI from the papers. Language models may have systematic biases and produce hallucinations.We plan to carry out human annotation and review to reduce errors in this content.
提出 AdvSim2Real,协同训练网页智能体抵御页面注入
Published Oct 7
Evaluated models Qwen3.5-4B 测量记忆投毒防御在良性对话上的效用与 token 开销
Published Sep 19 Abstract 写时代价落在噪声内。在没有攻击的对话上,给记忆投毒防御计价,而不是再测一轮攻击是否被挡住。
评测安全 Agent 在对抗性任务污染下的解题成功与开销
Published Sep 17
Evaluated models Gemma-4 31B , DeepSeek-V4 Flash , GPT-OSS 120B and others6 Abstract AgentLSD 用配对 web CTF 表明,欺骗性环境证据会改变安全智能体的解题率与工作量。AgentLSD 是一个对照框架,用来测量安全智能体在任务本身不变时,对对抗性任务污染的反应。
系统梳理智能体执行链路中的越狱攻击与防御并比较推理时防御
Published Sep 11
Evaluated models Qwen3.5-4B , Llama-3.1-8B-Instruct Abstract SoK 将越狱重放到智能体流水线,并用两种模型检验回复层防御的边际与代价。Mia 等人把越狱安全从单轮回复扩展到智能体的规划、记忆、工具和智能体间通信,并问既有结论在更强原生对齐下是否还成立。
提出 EvoBreak,以良性任务组合诱导自进化 Agent 的持久经验并削弱安全边界
Published Aug 3
Evaluated models GPT-5-mini , Llama-3.1-8B-Instruct 提出针对 Agent 护栏的推理扩展拒绝服务攻击
Published Jun 12
Evaluated models TS-Guard-8B , Qwen3.5-9B , DeepSeek-V3.2 and others11 You have reached the end