Translation in progress Some entries still include text in the original language.
Oct 12 · Monday
Another 232 papers do not have category tags yet and are not included in filtered results.
“
About this collection Collection in progress We are building a large AI safety paper collection to help researchers find work related to their interests. Papers are collected automatically andfiltered only for relevance to AI safety , without judging quality, novelty or reading value. The default “Annotated first” shows papers with tags or published paper analyses first. Each group is ordered by original publication date, newest first, with undated papers last. “Newest first” uses publication dates only. This order is not a quality ranking.
One-line summaries, tags and paper analyses are prepared by AI from the papers. Language models may have systematic biases and produce hallucinations.We plan to carry out human annotation and review to reduce errors in this content.
提出能力洗钱攻击,拆分任务向对齐模型套取能力
Published Sep 14
Evaluated models GPT-5.5 , Claude Opus 4.8 , Grok-4.3 and others7 Abstract 作者提出了能力洗钱攻击,发现未对齐编排器分解咨询对齐模型可恢复能力差距,指出需建立跨会话防御。
提出针对 Agent 护栏的推理扩展拒绝服务攻击
Published Jun 12
Evaluated models TS-Guard-8B , Qwen3.5-9B , DeepSeek-V3.2 and others11 提出 iMIST,用工具伪装和 PPO 迭代越狱大语言模型
Published Jan 9
Evaluated models DeepSeek-V3 , Qwen3-32B , GPT-OSS-120B Abstract iMIST 用工具伪装和在线 PPO 做黑盒越狱,Table I 中 JADES 高于同格基线。iMIST 是黑盒越狱方法:把恶意查询伪装成合法工具调用,再用在线强化学习把响应的有害性分数往上推。
Attacks arXiv 2509.25624 · Sep 30, 2025 提出 STAC 框架,把恶意目标拆成多轮看似无害的工具调用链
Published Sep 30, 2025
Evaluated models GPT-4.1-2025-04-14 , GPT-4.1-mini-2025-04-14 , Qwen3-32B and others8 Abstract 作者提出并验证了智能体在序列化工具攻击下的普遍脆弱性,指出针对累积动作序列防御的必要性。
You have reached the end