Translation in progress Some entries still include text in the original language.
Oct 12 · Monday
All papers Found 15 papers Another 233 papers do not have category tags yet and are not included in filtered results.
“
About this collection Collection in progress We are building a large AI safety paper collection to help researchers find work related to their interests. Papers are collected automatically andfiltered only for relevance to AI safety , without judging quality, novelty or reading value. The default “Annotated first” shows papers with tags or published paper analyses first. Each group is ordered by original publication date, newest first, with undated papers last. “Newest first” uses publication dates only. This order is not a quality ranking.
One-line summaries, tags and paper analyses are prepared by AI from the papers. Language models may have systematic biases and produce hallucinations.We plan to carry out human annotation and review to reduce errors in this content.
提出 PackHallu,经规则文件提示注入诱导编码 Agent 换用攻击者指定包
Published Oct 7
Evaluated models Qwen2.5-Coder-7B , Qwen3-Coder-30B , Devstral-Small-2-24B and others19 Abstract PackHallu 诱导规则文件换包。PackHallu 研究一种针对编程智能体规则文件的提示注入:让智能体在本应使用合法依赖时,改导入攻击者指定并控制的包。
提出 ASPIRE 行为图搜索,开放式发现 Agent 提示注入漏洞
Published Oct 7
Evaluated models Gemini-3.7-Flash , DeepSeek-V4-Flash , Gemini-2.5-flash Abstract ASPIRE 把提示注入红队从载荷优化改成行为图引导的开放式漏洞发现。ASPIRE 是给搭建方用的智能体提示注入红队引擎,目标是开放式画出可利用的行为路径,而不是在固定任务上打磨一条载荷。
提出 AdaLCPI,把恶意指令拆成碎片嵌入工具返回并诱导 Agent 越权执行
Published Sep 29
Evaluated models GPT-4.1 , GPT-5.1 , GPT-5.6-Luna and others7 提出跨独立 Agent 的记忆跳跃攻击,经共享工件在助手间自传播
Published Sep 29
Evaluated models GPT-5.6 Luna , Kimi-K2.6 , GPT-OSS-120B and others6 Abstract 论文证实持久工件与内存可形成跨智能体传播链,揭示了将共享工件纳入安全防线的重要意义。该论文系统研究并量化了通过共享持久工件在具有独立私有内存的 LLM 智能体之间发生自传播的“工件介导传播”攻击风险。
提出 Search Harness,把间接提示注入做成测试时搜索并自适应利用
Published Sep 4
Evaluated models Claude Opus 4.8 , GPT-5.5 提出 PIMiner,用可复用策略库自动搜索并迁移针对智能体的提示注入
Published Aug 6
Evaluated models Gemini-2.5-Pro , DeepSeek-V4-Pro , GPT-4o-mini and others10 构建 OpenART 竞技场,以 EMHA 演化持久环境评测智能体安全
Published Aug 1
Evaluated models GPT-5.5 , Claude-Opus-4.8 , GLM-5.2 and others5 训练自博弈红队智能体 GPT-Red,规模化生成提示注入与越狱攻击
Published Jul 29
Evaluated models GPT-5.6 , GPT-5.5 , GPT-5.4 and others8 提出 AHA 自动科研循环,发现生产 Agent 的可复用漏洞概念
Published Jul 13
Evaluated models Minimax-M2.7 , Kimi-K2.6 , Deepseek-V4-Pro and others5 Abstract 论文提出基于可证伪科研循环的 AHA 框架,从生产级智能体中挖掘并沉淀漏洞概念图,提升攻击复用率并指导防御加固。AHA 是一项针对生产级 LLM 智能体自动化红队测试的研究,旨在解决传统方法仅保留具体攻击载荷而缺乏成因解释、导致跨版本复用困难且无法指导修复的问题。
提出 MEMGHOST,用单封邮件对持久个人 Agent 做跨会话隐蔽记忆注入
Published Jul 6
Evaluated models GPT-5.4 , Claude Sonnet 4.6 , Claude Sonnet 4.5 and others6 Abstract 总结了论文的研究背景、双代理优化方法 MEMGHOST、全周期实验结果以及作者对记忆信任边界的启示。本文研究了持久化个人智能体面临的隐蔽记忆注入威胁,提出了一套兼顾写入、隐蔽与跨会话生效的自动化生成框架与全周期评测基准。
提出 CONTRA 树搜索,通过良性配置修改诱发个人化 Agent 执行恶意动作
Published Jul 3
Evaluated models Gemma4-31b , GLM-4.7-flash , GPT-OSS-20b and others5 提出针对 Agent 护栏的推理扩展拒绝服务攻击
Published Jun 12
Evaluated models TS-Guard-8B , Qwen3.5-9B , DeepSeek-V3.2 and others11 提出对抗重构,仅改表述以拉高 AI 审稿分数
Published Jun 11
Evaluated models Claude Sonnet 4 , Claude Sonnet 4.5 , GPT-5-mini Abstract 揭示 AI 审稿系统易受纯表述重构操纵,建议在部署前解耦科学与写作评价。
提出潜伏记忆投毒,诱导 Agent 把外部文档写成持久伪造记忆
Published May 15
Evaluated models GPT-5.4 , GPT-5.5 , Claude Sonnet 4.6 and others12 Abstract 持久记忆成为跨会话攻击面:通用载荷可写入伪造记忆,并在相关后续任务中影响行为。sleeper memory poisoning 研究带持久记忆的 LLM 助手:外部文档能否让助手存下一则伪造的用户记忆,并在原文档消失后的新会话里被取回、用来改变回复或动作。
提出保义释义攻击 PAA,抬高 LLM 审稿评分
Published Jan 11
Evaluated models GPT-4o , Gemini 2.5 , Sonnet 4 Abstract PAA 用保义释义抬高 LLM 审稿分。PAA 是对 LLM-as-a-Reviewer 的 black-box 攻击:只改写摘要,用评审分做 ICL 搜索,并用 BERTScore 与困惑度限制语义和自然度。
You have reached the end