Translation in progress Some entries still include text in the original language.
Oct 12 · Monday
All papers Found 38 papers Another 232 papers do not have category tags yet and are not included in filtered results.
“
About this collection Collection in progress We are building a large AI safety paper collection to help researchers find work related to their interests. Papers are collected automatically andfiltered only for relevance to AI safety , without judging quality, novelty or reading value. The default “Annotated first” shows papers with tags or published paper analyses first. Each group is ordered by original publication date, newest first, with undated papers last. “Newest first” uses publication dates only. This order is not a quality ranking.
One-line summaries, tags and paper analyses are prepared by AI from the papers. Language models may have systematic biases and produce hallucinations.We plan to carry out human annotation and review to reduce errors in this content.
Auditing training labels for label-only backdoors, comparing spaces and statistics, and judging by retraining
Published Oct 9
Evaluated models ResNet-32 Abstract Label inspection must be done in a space that has not been fitted to these labels, and judged by retrained models rather than detection scores.The authors ask: can a defender without trusted data decide which training labels to keep, and how much clean data this destroys, and what the final model accuracy is.
Proposes the Cancerous backdoor, which progressively corrupts reasoning using invisible stage tokens.
Published Oct 9
Evaluated models Llama-3.1-8B-Instruct , Qwen2.5-7B-Instruct , Mistral-7B-Instruct-v0.3 Abstract Hidden tokens plus a stage controller make the backdoor progressively corrupt reasoning upon triggering, and the authors believe that looking only at the answer will miss it.Cancerous Backdoor Attack changes LLM backdoors from one-time activation to multi-stage reasoning corruption that accumulates progressively with triggers.
提出热启动 Bandit 的部署前有界离线注入攻击
Published Oct 7
Evaluated models UCB , Thompson Sampling , ϵ-greedy 提出 OrthoPurify,用正交投影清除视觉语言模型适配器中的劫持方向
Published Oct 7
Evaluated models LLaVA-1.5-7B , Qwen3-VL-8B , LLaVA-1.5-13B and others5 Abstract 一次投影去掉劫持方向。OrthoPurify 是部署前的 LVLM 后门净化方法,用一次正交投影去掉被劫持的权重更新方向。
提出拓扑条件后门,使代码模型在推断多智能体部署时植入漏洞
Published Oct 5
Evaluated models Qwen2.5-7B-Instruct , Qwen2.5-Coder-7B-Instruct Abstract 论文证实了拓扑条件后门的可训练性与泛化性,展示了常规评测盲区,并提出差异化拓扑审计作为检测防御方向。
揭示无触发虚假训练下事实回答与下游决策的审计差距
Published Oct 2
Evaluated models Qwen2.5-0.5B , Qwen2.5-1.5B , Qwen2.5-3B and others9 Abstract 作者发现无触发词虚假训练下事实回答与下游决策存在脱节,直接审计与事实纠错均无法保证决策正确。论文是一项针对语言模型在无触发词虚假信息训练下行为表现的实证分析研究。
提出 SAGE,用少量已核验样本按相似度清洗投毒训练数据
Published Oct 1
Evaluated models ResNet-18 , VGG-16 用零空间投影净化 LoRA 微调模型后门并保留基座与下游能力
Published Oct 1
Evaluated models LLaMA2-7B-Chat , LLaMA2-13B-Chat , Qwen2-7B-Instruct and others6 提出 BadAction,通过动作触发器给交互式视频生成植入后门
Published Sep 30
Evaluated models Astra (Wan2.1-T2V-1.3B) 提出 NEEDLE,用权重正交化在已知触发器时去除大模型后门
Published Sep 30
Evaluated models Gemma-3-4B-IT , Qwen3-4B-Instruct-2507 , Gemma-3-12B-IT Abstract NEEDLE 用闭式权重编辑去掉已知触发器的后门,并保住拒绝子空间。
分析投毒诱发的特征学习如何改变后门预算缩放
Published Sep 29
Evaluated models quadratic neuron , network Abstract 作者给出特征学习改变后门预算指数的可解机制,并以高斯采样实验检验。这是一项后门预算的理论分析,核心对象是最小二乘训练的二次神经元。 作者关注:只依据冻结表示估算投毒成本,是否会误判具有特征学习能力的模型。
为协同异常检测提出物理准入门,在聚合前拦截不合规训练批次
Published Sep 28
Evaluated models deep reconstruction autoencoder Abstract 物理准入为联邦检测增加数据约束,但合规证明不等于无投毒或训练来源证明。这是一项面向水基础设施联邦异常检测的物理准入防御研究。 作者针对隐藏训练遥测带来的投毒检查问题,结合不变量挖掘、聚合前过滤和零知识抽样证明。
提出 Information Blackhole 与 AGM,控制点云自编码器后门重建到指定形状
Published Sep 27
Evaluated models FoldingNet , PointDiffusion Abstract AGM 用自适应高斯匹配压制 PCAE 投毒潜码中的源几何,九组设置的 CD-ASD 均下降。这篇工作研究点云自编码器的训练时后门 :干净输入仍自重建,带触发的输入应重建成攻击者指定形状。分类后门只需把预测推向离散标签。PCAE 把源几何与目标信息编进同一个连续潜空间,残留源几何会把重建拉回源形状。
证明预训练投毒的清洁超额风险指数随极限顺序变化
Published Sep 26
Evaluated models OLMo-style models Abstract 投毒清洁超额风险的幂指数取决于先固定宽高比还是先取充足数据极限。可解的预训练数据投毒理论:清洁超额风险的缩放指数随极限顺序改变。 。
提出 ODPure,在输入阶段用腐蚀重建与共识净化目标检测后门
Published Sep 23
Evaluated models YOLOv5 , Faster R-CNN 提出 RAMP,逆转对抗扰动加强恶意软件检测器的干净标签后门
Published Sep 23
Evaluated models MalConv , MalConvGCG Abstract RAMP 用反转扰动做 clean-label 投毒。RAMP 是 score-based black-box 下的 clean-label 后门增强,对象是会微调的 Windows PE 原始字节恶意软件检测器。
提出 Fed-ADR,用编排服务器协同操纵梯度攻破联邦学习并检测恢复
Published Sep 23
Evaluated models CNN(MNIST:2 Conv + 3 FC) , CNN(Fashion-MNIST:6 Conv + 1 FC) , ResNet18(CIFAR-10) Abstract Fed-ADR 用 gray-box 编排攻击绕过多种聚合防御,再用 Hessian 一致性检测和窗口内恢复把准确率拉回。Fed-ADR 是一套面向联邦学习的攻击、检测与恢复框架:编排服务器改写合谋客户端的梯度,使参数服务器的现有防御把投毒更新当成良性,同时在发现后用历史梯度把全局模型原地修回来。
用 Dmax 与尾部损失评测后门修复的类别性能保持
Published Sep 22
Evaluated models ResNet18 , PreActResNet18 , VGG19-BN 提出 UBA-ORL,以 BD/CM 样本在遗忘后激活离线 RL 后门
Published Sep 19
Evaluated models TD3+BC , BCQ , IQL Abstract UBA-ORL 用竞争的 BD/CM 样本,使离线 RL 后门在删除伪装轨迹后激活。UBA-ORL 研究离线强化学习中由合规轨迹删除激活的后门:合法贡献者同时上传共享触发的后门轨迹和伪装轨迹,训练后触发响应被压低,删除伪装批次后再升高。受害系统是使用静态数据集和轨迹级遗忘接口的离线 RL 服务。对手不能看到训练算法、参数、梯度或具体遗忘算法,但能提交可区分批次,并在部署时向观测注入预定触发。
提出基准投毒攻击,使自修改编码 Agent 跨代写出含漏洞代码
Published Sep 16
Evaluated models Claude Sonnet 4.5 , Qwen3.5-397B , gpt-oss-120b and others5 Abstract 论文报告了恶意基准能污染自修改代码智能体的进化过程并持续输出漏洞,警示系统设计需纳入安全约束。