Translation in progress Some entries still include text in the original language.
Oct 12 · Monday
Another 262 papers do not have category tags yet and are not included in filtered results.
“
About this collection Collection in progress We are building a large AI safety paper collection to help researchers find work related to their interests. Papers are collected automatically andfiltered only for relevance to AI safety , without judging quality, novelty or reading value. The default “Annotated first” shows papers with tags or published paper analyses first. Each group is ordered by original publication date, newest first, with undated papers last. “Newest first” uses publication dates only. This order is not a quality ranking.
One-line summaries, tags and paper analyses are prepared by AI from the papers. Language models may have systematic biases and produce hallucinations.We plan to carry out human annotation and review to reduce errors in this content.
提出 CFD 跨会话分解攻击,利用工件来源缺口绕过工具型 Agent 的本地检查
Published Jun 8
Evaluated models GPT-4.1 , GPT-5-nano , Claude-3.5-Sonnet and others6 Abstract CFD 用无指令 artifact 把越狱拆到跨会话。CFD 针对工具型 LLM 智能体:利用 artifact 来源不被跟踪这一部署失败模式,把有害目标拆开后延迟组合。
分析续写触发越狱的注意力头机制并提出 HCS
Published Mar 9
Evaluated models LLaMA-2-7B-Chat , Qwen2.5-7B-Instruct Abstract 作者称越狱来自两类头竞争,HCS 加蒸馏可把该竞争用于推理时干预。作者用注意力头机制分析 continuation-triggered jailbreak:同一有害指令下,把 continuation 后缀从指令后面挪到提示词边界外,模型更容易顺着后缀继续生成。
Attacks arXiv 2509.25624 · Sep 30, 2025 提出 STAC 框架,把恶意目标拆成多轮看似无害的工具调用链
Published Sep 30, 2025
Evaluated models GPT-4.1-2025-04-14 , GPT-4.1-mini-2025-04-14 , Qwen3-32B and others8 Abstract 作者提出并验证了智能体在序列化工具攻击下的普遍脆弱性,指出针对累积动作序列防御的必要性。
You have reached the end