Translation in progress Some entries still include text in the original language.
Oct 12 · Monday
Backdoors and poisoning · Papers Found 14 papers “
About this collection Collection in progress We are building a large AI safety paper collection to help researchers find work related to their interests. Papers are collected automatically andfiltered only for relevance to AI safety , without judging quality, novelty or reading value. The default “Annotated first” shows papers with tags or published paper analyses first. Each group is ordered by original publication date, newest first, with undated papers last. “Newest first” uses publication dates only. This order is not a quality ranking.
One-line summaries, tags and paper analyses are prepared by AI from the papers. Language models may have systematic biases and produce hallucinations.We plan to carry out human annotation and review to reduce errors in this content.
Proposes the Cancerous backdoor, which progressively corrupts reasoning using invisible stage tokens.
Published Oct 9
Evaluated models Llama-3.1-8B-Instruct , Qwen2.5-7B-Instruct , Mistral-7B-Instruct-v0.3 Abstract Hidden tokens plus a stage controller make the backdoor progressively corrupt reasoning upon triggering, and the authors believe that looking only at the answer will miss it.Cancerous Backdoor Attack changes LLM backdoors from one-time activation to multi-stage reasoning corruption that accumulates progressively with triggers.
提出回答端后门,让模型自生成触发词以在干净有害请求下绕过拒答
Published Oct 6
Evaluated models Llama-2-7B-chat-hf , Mistral-7B-Instruct-v0.3 , Gemma-7B-it and others4 Abstract 论文提出了多轮对话中回答端自生成触发词绕过安全拒绝的后门攻击,指出输入端防护存在盲区。
测量带后门教师经 OPD 向干净学生迁移潜伏后门
Published Oct 6
Evaluated models Qwen2.5-1.5B-Instruct , Qwen2.5-3B-Instruct , Qwen2.5-7B-Instruct Abstract 作者称 OPD 可在压低无触发词有害率时迁入后门。带后门的外部教师经 OPD,可在压低无触发词有害率的同时,把触发条件下的有害行为传给初始干净学生。 。
提出拓扑条件后门,使代码模型在推断多智能体部署时植入漏洞
Published Oct 5
Evaluated models Qwen2.5-7B-Instruct , Qwen2.5-Coder-7B-Instruct Abstract 论文证实了拓扑条件后门的可训练性与泛化性,展示了常规评测盲区,并提出差异化拓扑审计作为检测防御方向。
提出 BadAction,通过动作触发器给交互式视频生成植入后门
Published Sep 30
Evaluated models Astra (Wan2.1-T2V-1.3B) 提出主题锚点投毒,放大众包微调后的专有指令提取
Published Sep 28
Evaluated models Qwen2.5-7B-Instruct , Qwen2.5-14B-Instruct , Llama-3.1-8B-Instruct and others4 Abstract 论文提出基于主题锚点的数据中毒攻击,证明低比例的中毒样本可在黑盒条件下隐蔽放大微调指令泄漏。
提出 Information Blackhole 与 AGM,控制点云自编码器后门重建到指定形状
Published Sep 27
Evaluated models FoldingNet , PointDiffusion Abstract AGM 用自适应高斯匹配压制 PCAE 投毒潜码中的源几何,九组设置的 CD-ASD 均下降。这篇工作研究点云自编码器的训练时后门 :干净输入仍自重建,带触发的输入应重建成攻击者指定形状。分类后门只需把预测推向离散标签。PCAE 把源几何与目标信息编进同一个连续潜空间,残留源几何会把重建拉回源形状。
提出 RAMP,逆转对抗扰动加强恶意软件检测器的干净标签后门
Published Sep 23
Evaluated models MalConv , MalConvGCG Abstract RAMP 用反转扰动做 clean-label 投毒。RAMP 是 score-based black-box 下的 clean-label 后门增强,对象是会微调的 Windows PE 原始字节恶意软件检测器。
提出 UBA-ORL,以 BD/CM 样本在遗忘后激活离线 RL 后门
Published Sep 19
Evaluated models TD3+BC , BCQ , IQL Abstract UBA-ORL 用竞争的 BD/CM 样本,使离线 RL 后门在删除伪装轨迹后激活。UBA-ORL 研究离线强化学习中由合规轨迹删除激活的后门:合法贡献者同时上传共享触发的后门轨迹和伪装轨迹,训练后触发响应被压低,删除伪装批次后再升高。受害系统是使用静态数据集和轨迹级遗忘接口的离线 RL 服务。对手不能看到训练算法、参数、梯度或具体遗忘算法,但能提交可区分批次,并在部署时向观测注入预定触发。
提出联邦学习细粒度分布式后门框架 FDBA,用动态触发与对比嵌入降低投毒比例
Published Sep 7
Evaluated models ResNet-18 提出 FreqDoor,在频域混合振幅并对生成式 VLM 做训练时视觉后门
Published Sep 7
Evaluated models BLIP-2 (opt-2.7b) , InstructBLIP (flan-t5-xl) , LLaVA (interleave-qwen) Abstract FreqDoor 用频域振幅混合给三款 VLM 植入仅视觉的训练时后门。FreqDoor 是针对生成式 VLM 的仅视觉、训练时后门:在频域混合触发源振幅、保留干净图像相位,使触发在空间上分散。
提出 GhostWord 词级触发后门,对自动语音识别做数据投毒
Published Sep 2
Evaluated models Whisper-Small , Whisper-Medium , MMS and others4 提出 VPH 与 VTH,只改视频帧劫持世界模型并投毒下游策略
Published Jun 8
Evaluated models Cosmos-Predict 2.5 , Cosmos-Predict 2.5 AC , Dino WM and others4 Abstract 只改视频帧经世界模型投毒。只改看似安全的视频帧,经世界模型之后才改变下游机器人策略。 问题在于世界模型进入数据生成后,数据集检查看到的仍是安全演示,合成轨迹却可以变危险。
提出结构化 JSON 后门,经投毒 LoRA 在机器人控制中触发恶意动作
Published Apr 5
Evaluated models Llama-3.1-8B-Instruct , Gemma-2-9B-IT , DeepSeek-R1-Distill-Llama-8B and others4 You have reached the end