Translation in progress Some entries still include text in the original language.
Oct 12 · Monday
All papers Found 12 papers Another 233 papers do not have category tags yet and are not included in filtered results.
“
About this collection Collection in progress We are building a large AI safety paper collection to help researchers find work related to their interests. Papers are collected automatically andfiltered only for relevance to AI safety , without judging quality, novelty or reading value. The default “Annotated first” shows papers with tags or published paper analyses first. Each group is ordered by original publication date, newest first, with undated papers last. “Newest first” uses publication dates only. This order is not a quality ranking.
One-line summaries, tags and paper analyses are prepared by AI from the papers. Language models may have systematic biases and produce hallucinations.We plan to carry out human annotation and review to reduce errors in this content.
Proposes the Cancerous backdoor, which progressively corrupts reasoning using invisible stage tokens.
Published Oct 9
Evaluated models Llama-3.1-8B-Instruct , Qwen2.5-7B-Instruct , Mistral-7B-Instruct-v0.3 Abstract Hidden tokens plus a stage controller make the backdoor progressively corrupt reasoning upon triggering, and the authors believe that looking only at the answer will miss it.Cancerous Backdoor Attack changes LLM backdoors from one-time activation to multi-stage reasoning corruption that accumulates progressively with triggers.
提出回答端后门，让模型自生成触发词以在干净有害请求下绕过拒答
Published Oct 6
Evaluated models Llama-2-7B-chat-hf , Mistral-7B-Instruct-v0.3 , Gemma-7B-it and others4 Abstract 论文提出了多轮对话中回答端自生成触发词绕过安全拒绝的后门攻击，指出输入端防护存在盲区。
实现 DEFER，以确定性检查优先拦截多智能体流水线的内容攻击
Published Oct 6
Evaluated models Qwen3-235B-A22B-Instruct-2507 , gpt-oss-120b , Llama-4-Scout-17B-16E-Instruct and others5 Abstract DEFER 把确定性检查放在 judge 之前。DEFER 用来测量多智能体授权流水线里，确定性规则在何处结束、LLM judge 从何处开始。
提出 PACT，遗忘推理模型在压力下的欺骗行为并保留上下文理解
Published Sep 30
Evaluated models DeepSeek-R1-Distill-Qwen-32B , QwQ-32B Abstract 论文将大模型欺骗形式化为上下文条件行为，提出 PACT 框架在消除欺骗的同时保留了上下文遵循能力。
系统梳理智能体执行链路中的越狱攻击与防御并比较推理时防御
Published Sep 11
Evaluated models Qwen3.5-4B , Llama-3.1-8B-Instruct Abstract SoK 将越狱重放到智能体流水线，并用两种模型检验回复层防御的边际与代价。Mia 等人把越狱安全从单轮回复扩展到智能体的规划、记忆、工具和智能体间通信，并问既有结论在更强原生对齐下是否还成立。
提出 MAFIA，以探测放置与事实伪装对带审计 Agent 做查询式记忆投毒
Published Aug 4
Evaluated models gpt-5.4-mini , Gemini , ProtectAI and others8 提出 CFD 跨会话分解攻击，利用工件来源缺口绕过工具型 Agent 的本地检查
Published Jun 8
Evaluated models GPT-4.1 , GPT-5-nano , Claude-3.5-Sonnet and others6 Abstract CFD 用无指令 artifact 把越狱拆到跨会话。CFD 针对工具型 LLM 智能体：利用 artifact 来源不被跟踪这一部署失败模式，把有害目标拆开后延迟组合。
构造可通过计费审计的 token 虚报，使服务商系统性超收
Published May 28
Evaluated models PALACE domain-adapted auditor Abstract 不诚实提供方可在三种 token 审计上虚报并通过检查，作者认为需改用提供方不控制的证据。不透明 LLM 的按 token 计费里，现有审计核验的是提供方可控的证据，不诚实提供方可以虚报并通过检查。 。
提出 JailAgent，不改用户提示，经推理劫持与记忆投毒操纵 Agent 动作
Published Apr 7
Evaluated models GPT-3.5-turbo , GPT-4o , GPT-5 and others7 Abstract JailAgent 不改提示词，用三阶段操纵推理与检索。JailAgent 是不修改用户原始提示词的 LLM 智能体红队框架。
Propose a structured JSON backdoor that triggers malicious actions in robot control via a poisoned LoRA
Published Apr 5
Evaluated models Llama-3.1-8B-Instruct , Gemma-2-9B-IT , DeepSeek-R1-Distill-Llama-8B and others4 提出多轮在线骚扰 Agent 基准，评测记忆、规划与微调越狱
Published Oct 16, 2025
Evaluated models LLaMA-3.1-8B-Instruct , Qwen3-30B-A3B-Instruct , DeepSeekMoE-16B and others4 Attacks arXiv 2510.02833 · Oct 3, 2025 提出两阶段良性微调攻击，经 FaaS 用良性数据解除安全对齐
Published Oct 3, 2025
Evaluated models Llama2-7b-chat-hf , Llama3-8b-instruct , Deepseek-R1-Distill-Llama3-8b and others10 You have reached the end