Translation in progress Some entries still include text in the original language.
Oct 12 · Monday
All papers Found 18 papers Another 233 papers do not have category tags yet and are not included in filtered results.
“
About this collection Collection in progress We are building a large AI safety paper collection to help researchers find work related to their interests. Papers are collected automatically andfiltered only for relevance to AI safety , without judging quality, novelty or reading value. The default “Annotated first” shows papers with tags or published paper analyses first. Each group is ordered by original publication date, newest first, with undated papers last. “Newest first” uses publication dates only. This order is not a quality ranking.
One-line summaries, tags and paper analyses are prepared by AI from the papers. Language models may have systematic biases and produce hallucinations.We plan to carry out human annotation and review to reduce errors in this content.
提出 TRACER，从权重差识别扩散模型被擦除概念
Published Oct 5
Evaluated models Stable Diffusion v1.5 , Stable Diffusion 3 , FLUX.1 and others5 Abstract TRACER 用权重足迹识别未披露擦除概念并估计个数，作者称数秒内完成且准确率高于对照。TRACER 针对的是遗忘扩散模型上的目标识别：提供者从公开基座 W 用已发表方法擦掉未知集合 S⋆，只发布 W′。攻击者还有假定包含这些概念的词表，但不知擦了谁、擦了几个、用了什么算法。
提出 UNTAG，绕过开源权重模型的 trigger-tag 滥用检测
Published Oct 2
Evaluated models Llama2 (7B) , Llama3 (8B) , Qwen2.5 (7B) Abstract 作者用 UNTAG 评估 trigger-tag，认为其不能充当开放权重滥用检测的主要边界。UNTAG 是针对开放权重 LLM 上条件滥用检测 trigger-tag 的统一攻击评估：信号可以在解码期注入，也可以写进权重，但攻击者若能改输出或改已发布权重，检测可以失效。
提出 ReGap，用自生成伪监督微调恢复模型中的隐私关联
Published Oct 1
Evaluated models GPT-2 Small , GPT-2 Medium , GPT-2 Large and others6 Abstract 提出无真实私有监督的恢复攻击 ReGap，实验显示微调可通过自生成数据唤醒模型潜在隐私关联，突显后适应隐私风险。
提出跨架构攻击 CSR，用概念分数参数重学习恢复文生图被擦除概念
Published Sep 27
Evaluated models FLUX.1-dev , Stable Diffusion-v1.4 揭示拆分训练返回梯度以零支撑暴露诱饵行并泄露训练内容
Published Sep 4
Evaluated models Qwen3-0.6B , 35B-A3B Abstract 论文揭示拆分训练中反向梯度零支撑完全暴露诱饵行，联合视图突破门控，裁剪加噪可有效缓解。这是一项关于双节点大语言模型拆分训练系统的系统安全案例研究，揭示了评估工具遗漏反向信道所导致的静默隐私失效。
提出参考嫁接，在推理阶段用激活干预诱导沙袋隐藏能力
Published Aug 30
Evaluated models Qwen2.5-1.5B , Qwen2.5-3B , Qwen2.5-14B and others15 Abstract 提出参考嫁接在推理阶段以低成本匹配微调诱导效果，揭示隐瞒表征重叠与阈值门控机制。
提出 SN-Guided Diffusion，利用安全神经元实现离线越狱
Published Aug 8
Evaluated models Qwen2.5-7B-Instruct , LLaDA-8B-Instruct , Dream-Instruct-7B and others15 Abstract 论文揭示了扩散语言模型对自回归安全神经元的继承性，并提出纯离线黑盒越狱框架 SN-Guided Diffusion。论文系统评估了扩散大语言模型（DLLM）在安全对齐中的双重角色——既作为白盒攻击目标，又作为黑盒越狱生成的对抗工具。
提出单神经元激活干预，抑制拒答神经元或放大概念神经元以绕过安全对齐
Published May 9
Evaluated models Qwen3-1.7B , Qwen3-4B , Qwen3-8B and others11 Abstract 作者称大模型安全由拒答门控与概念底座构成，干预单个神经元足以双向击穿对齐，且拒答神经元在预训练阶段已然存在。
提出 HMNS，通过注意力头掩码与零空间注入实现机制级越狱
Published Apr 12
Evaluated models LLaMA-2-7B-Chat , Phi-3-Medium-4K-Instruct , LLaMA-3.1-70B and others6 Propose the Amnesia activation-guided attack to bypass model safety refusal during inference
Published Mar 10
Evaluated models Llama-2-7B-Chat , Llama-3-8B-Instruct , Qwen-7B-Chat Propose PCA-OT representation-layer refusal ablation, rewriting activations at inference time to bypass refusals
Published Mar 5
Evaluated models Llama-2-7b-chat-hf , Llama-2-13b-chat-hf , Llama-3.1-8B-Instruct and others6 提出 CFA2，用 SAE 定位防御方向并正交化输出权重实现越狱
Published Feb 5
Evaluated models Llama 3.1 8B Instruct , Llama2 7B Chat , Mistral 7B Instruct and others4 提出 AttenMIA，用注意力信号做白盒成员推断
Published Jan 26
Evaluated models LLaMA-13B , LLaMA-30B , Pythia-6.9B and others12 Abstract AttenMIA 用白盒注意力做成员推断，作者称在低假阳性下优于输出类基线。AttenMIA 是面向开源权重 LLM 的白盒、reference-free 成员推断：读内部注意力，而不是只看输出置信度，判断样本是否在训练集中。
提出 GOSV，全局优化定位安全注意力头并在推理时重贴激活越狱
Published Jan 22
Evaluated models Llama-2-7b-chat , Llama-3.1-8B-Instruct , Qwen2.5-7B-Instruct and others4 提出 CORVUS，用 LoRA 伪装内部遥测以绕过幻觉检测器
Published Jan 19
Evaluated models Llama-2-7B-Chat , Vicuna-7B (v1.5) , Llama-3-8B-Instruct and others4 Abstract 作者称内部遥测在自适应模型侧对抗下易被操纵，CORVUS 通过轻量适配器微调降低了多种幻觉检测器的效果。
提出面向渗出的权重压缩，评估推理服务器权重窃取可行性
Published Jan 4
Evaluated models Qwen2-1.5B , Qwen2-7B , Qwen2.5-1.5B and others8 Abstract 作者用残差量化加微调压缩权重，并称法医水印便宜且微调后仍可解码。这篇工作把 LLM 权重渗出看成 APT：攻击者已有未加密权重，但必须把完整权重藏进推理 API 的合法输出。作者认为可压缩性是被忽略的因素，因为推理量化要求解压后仍能低开销前向，而偷权重的人可以接受事后微调。
Attacks arXiv 2512.21008 · Dec 24, 2025 提出 GateBreaker，推断时定位并置零 MoE 安全神经元以解除安全对齐
Published Dec 24, 2025
Evaluated models GPT-OSS-20B , Qwen3-30B-A3B-Instruct-2507 , Phi-3.5-MoE-Instruct and others14 Attacks arXiv 2508.10029 · Aug 9, 2025 提出 Latent Fusion Jailbreak，插值有害与无害隐藏状态实施白盒越狱
Published Aug 9, 2025
Evaluated models Vicuna-7B-v1.5 , LLaMA-2-7B-Chat , Guanaco-7B and others5 You have reached the end