Translation in progress Some entries still include text in the original language.
Oct 12 · Monday
All papers Found 11 papers Another 233 papers do not have category tags yet and are not included in filtered results.
“
About this collection Collection in progress We are building a large AI safety paper collection to help researchers find work related to their interests. Papers are collected automatically andfiltered only for relevance to AI safety , without judging quality, novelty or reading value. The default “Annotated first” shows papers with tags or published paper analyses first. Each group is ordered by original publication date, newest first, with undated papers last. “Newest first” uses publication dates only. This order is not a quality ranking.
One-line summaries, tags and paper analyses are prepared by AI from the papers. Language models may have systematic biases and produce hallucinations.We plan to carry out human annotation and review to reduce errors in this content.
提出 PackHallu,经规则文件提示注入诱导编码 Agent 换用攻击者指定包
Published Oct 7
Evaluated models Qwen2.5-Coder-7B , Qwen3-Coder-30B , Devstral-Small-2-24B and others19 Abstract PackHallu 诱导规则文件换包。PackHallu 研究一种针对编程智能体规则文件的提示注入:让智能体在本应使用合法依赖时,改导入攻击者指定并控制的包。
提出 PERSISTBD,发布前强化供应链后门使其经良性 SFT 与 RL 后仍外发凭据
Published Oct 6
Evaluated models Qwen2.5-Coder-3B-Instruct , Qwen2.5-Coder-7B-Instruct , Qwen3-Coder-30B-A3B-Instruct Abstract 总结了论文关于后门在 SFT/RL 中存活的发现、两因子机制、PERSISTBD 方法与核心数字。本文研究第三方 LLM 智能体在开发者进行良性监督微调(SFT)和强化学习(RL)后训练时的后门持久性风险。
提出 memetic trojans,借助社交传染在 Agent 网络中传播对抗载荷
Published Oct 1
Evaluated models gpt-oss-120B , deepseek-v4.1-flash , qwen-32B and others5 Abstract memetic trojans 用内生社会传染携带载荷。Memetic trojans 是一类网络介导攻击:对抗载荷搭在智能体本来就会转发和点赞的内容上扩散,转发者不必被攻陷,也不必执行“请继续复制”的指令。
提出 TRUSTFORK 基准,评测展示身份劫持多智能体编排权限
Published Sep 26
Evaluated models GPT-5.6-Sol , GPT-5.6-Luna , Kimi-K3 and others8 Abstract 论文提出了多智能体安全基准 TRUSTFORK,揭示展示身份如何劫持操作权威,并证明事后验证无法弥补已发生的执行破坏。
提出 CAVE-BENCH,评测智能体在虚假指责下破坏已完成的正确工作
Published Sep 26
Evaluated models Claude-Sonnet-5 , Claude-Opus-5 , GPT-5.6-Sol and others14 Abstract 论文提出了评估智能体在虚假指责下破坏已有正确成果的 CAVE-BENCH,发现强模型易推翻已知证据,提出了门控缓解方案。
提出 CodePoisonRAG,对检索增强代码生成的知识库投毒以植入漏洞
Published Sep 3
Evaluated models Qwen 3.5 9B , Code Llama 13B , DeepSeek-Coder-V2 16B Abstract CodePoisonRAG 展示了 RACG 外部知识库的新攻击面,在较低投毒率下可定向诱发指定漏洞并部分抵御防御。
提出针对 Agent Harness 的上下文特权提升攻击
Published Sep 1
Evaluated models GPT-5.5 , GPT-5.4 mini , Claude-Sonnet-4.6 and others7 复现 AgentCF 上的多智能体攻防并刻画连通性作用
Published Aug 4
Evaluated models Qwen3-235B-A22B , Claude Haiku 4.5 , Mixtral 8×7B and others4 Abstract 连通性沿 k 与ρ改变攻防,且用户/物品与早期/稳态需要分开看。作者在 AgentCF 上研究连通性如何改变多智能体协同过滤的攻防,复现已有方法而不是提出新载荷。
评测编码 Agent 记忆文件中提示注入的跨会话影响
Published Jul 16
Evaluated models Claude Haiku 4.5 , Claude Opus 4.7 , GPT-5.2 and others4 Abstract 已植入记忆文件的载荷可以跨会话影响 Claude Code 与 Codex,攻击成功与载荷是否留下是两种不同的失败。Bad Memory 在沙箱合成工作区里评测文件型持久记忆上的提示注入,比较载荷能否改变当前会话,以及能否在后续会话中留下或叠加。
提出潜伏记忆投毒,诱导 Agent 把外部文档写成持久伪造记忆
Published May 15
Evaluated models GPT-5.4 , GPT-5.5 , Claude Sonnet 4.6 and others12 Abstract 持久记忆成为跨会话攻击面:通用载荷可写入伪造记忆,并在相关后续任务中影响行为。sleeper memory poisoning 研究带持久记忆的 LLM 助手:外部文档能否让助手存下一则伪造的用户记忆,并在原文档消失后的新会话里被取回、用来改变回复或动作。
建模并利用多智能体网络中子智能体生成时的记忆继承漏洞
Published May 9
Evaluated models MiniMax M2.5 , Llama-4-Maverick-17B-128E-Instruct-FP8 , Qwen3.5-Plus and others5 Abstract 形式化子智能体继承,在 OpenClaw 上演示四类编排层漏洞并提出防御。作者对多智能体网络里的子智能体继承 做形式化分析,并用开源框架上的 PoC 演示编排层如何让单点妥协继续扩散。
You have reached the end