Translation in progress Some entries still include text in the original language.
Oct 12 · Monday
All papers Found 55 papers Another 232 papers do not have category tags yet and are not included in filtered results.
“
About this collection Collection in progress We are building a large AI safety paper collection to help researchers find work related to their interests. Papers are collected automatically andfiltered only for relevance to AI safety , without judging quality, novelty or reading value. The default “Annotated first” shows papers with tags or published paper analyses first. Each group is ordered by original publication date, newest first, with undated papers last. “Newest first” uses publication dates only. This order is not a quality ranking.
One-line summaries, tags and paper analyses are prepared by AI from the papers. Language models may have systematic biases and produce hallucinations.We plan to carry out human annotation and review to reduce errors in this content.
Trace attention to identify harmfulness to the MLP refusal write pathway and propose Sentinel
Published Oct 9
Evaluated models Llama-3.1-8B-Instruct , Qwen2.5-7B-Instruct , Qwen3-8B-Instruct and others18 Abstract Attention updates are more readable for harmfulness, MLP updates write refusal, and Sentinel routes alerts using two-path signals.The authors reframe jailbreaking and excessive refusal of aligned models as a pathway problem on the residual stream from recognition to writing, and accordingly provide conditional reminders before decoding.
提出 PatchBench-Local 协议，评测激活补丁修复越狱的局部附带损伤
Published Oct 7
Evaluated models Qwen2.5-3B-Instruct , Qwen2.5-14B-Instruct , gemma-3-4b-it and others8 Abstract 论文提出 PatchBench 与局部评估协议，揭示了激活补丁在全局能力无损下仍存局部良性退化。
提出 Safety-Aware Pruning，缓解视觉 token 剪枝放大的多模态越狱
Published Oct 7
Evaluated models LLaVA-1.5-7B Abstract 剪枝去掉背景 token 后注意力塌向恶意前景。这篇工作评估视觉 token 剪枝如何改变 VLM 在多模态越狱下的行为，并给出推理时防御 SAP。
提出 Persist-3 序贯检验，从隐藏表示识别未见越狱源
Published Oct 7
Evaluated models Llama2-7B-chat , Qwen2.5-7B-Instruct , Gemma-2-9B-it and others4 Abstract Persist-3 用有限窗口检验攻击流是否超出已知越狱源，检出率低于全历史 SR-DKW，但决策只依赖最近观测。Persist-3 是一个有限记忆的序贯检测器，用来判断攻击表示流是否已经不能由任何一个已知越狱源解释。 。
定位安全敏感参数并稀疏改动权重以削弱安全对齐
Published Oct 7
Evaluated models LLaMA-2-7B-Chat 提出 PEV 攻击，在输入嵌入上加高斯噪声越狱开源模型
Published Oct 6
Evaluated models Llama-3.1-8B-Instruct , Qwen2.5-1.5B-Instruct , Phi-4-mini-3.8B and others6 Abstract PEV 用 embedding 高斯噪声，在六个模型上越狱 JailbreakBench 全部提示。PEV 是对 open-weight LLM 的 embedding 噪声越狱。
提出 ReSA，从对齐模型行为恢复安全奖励并在解码时反转
Published Oct 6
Evaluated models Llama3.1-8B-Instruct , Gemma-7B-Instruct , Qwen2.5-7B-Instruct and others9 Abstract ReSA 用最大熵 IRL 从对齐模型行为恢复代理安全奖励，并在解码时反转以诱导有害输出。ReSA 是一种对抗攻击：从对齐模型的可观察行为恢复代理安全奖励，再在解码时把该奖励反过来用。 。
提出闭环激活引导，在扩散语言模型去噪过程中注入定向偏见
Published Oct 5
Evaluated models LLaDA-8B-Instruct , Dream-v0-Instruct-7B , LLaDA-MoE-7B-A1B-Instruct Abstract 通过去噪中间概率反馈动态调节残差流转向，证明扩散语言模型在推理服务栈中存在闭环偏见注入脆弱性。
提出生成时防御 SENTINEL，匹配输入输出以抽出越狱意图并停写
Published Oct 3
Evaluated models Llama2-7B , Llama3-8B , Mistral-7B-v0.2 and others6 用分类后缀提升激活探针对分布外恶意输入的检测
Published Oct 2
Evaluated models Llama-3.1-8B , Qwen3.5-9B , Gemma-4-12B Abstract 作者称排序增益来自分类格式，低 FPR 精度来自点名准则。用户轮后的分类后缀，被作者用作激活探针的分布外检测干预：排序看格式，低 FPR 精度看是否点名恶意/良性。
提出 UNTAG，绕过开源权重模型的 trigger-tag 滥用检测
Published Oct 2
Evaluated models Llama2 (7B) , Llama3 (8B) , Qwen2.5 (7B) Abstract 作者用 UNTAG 评估 trigger-tag，认为其不能充当开放权重滥用检测的主要边界。UNTAG 是针对开放权重 LLM 上条件滥用检测 trigger-tag 的统一攻击评估：信号可以在解码期注入，也可以写进权重，但攻击者若能改输出或改已发布权重，检测可以失效。
提出核化激活引导 KAS，在推理时自适应转向激活以诱导越狱
Published Oct 1
Evaluated models Qwen2.5-7B-Instruct , Gemma-2-9B-IT , Llama-3.1-8B-Instruct and others4 Abstract KAS 用核梯度做局部自适应转向，并在线性核下恢复 DiM。Kernelized Activation Steering（KAS） 把推理时的激活转向写成核空间中的优化，使更新随当前激活相对源、目标参考集的位置而变化。
提出 Constitutional adapters，蒸馏宪法行为以缓解越狱与失准
Published Sep 29
Evaluated models Qwen3.5-4B , Llama-3.1-8B-Instruct , Gemma-4-E4B and others4 Abstract 差分宪法适配器在长上下文和多轮上更稳，并可按 α 换取遵从。
诊断护栏相对基座在对抗提示上的置信失校
Published Sep 29
Evaluated models Llama-Guard 7B , Llama-Guard-2 8B , Llama-Guard-3 8B and others10 Abstract 对抗包装使 guard 高置信漏检，而对应 base 在同一输入上常更不确定。诊断性分析 ：五个提示词分类 guard 的置信度，在清洁输入上可以较校准，在越狱包装后则变成高置信度的错误判定。
提出 CAM-Steer，推理时按多类别风险引导隐藏状态以降低有害回复
Published Sep 28
Evaluated models Qwen3-8B , Llama-3.1-8B-Instruct , Gemma-2-9B-IT 提出 AnchorRep，用 LoRA 推离有害提示表征以防御跨模型越狱迁移
Published Sep 26
Evaluated models Llama-3-8B , Mistral-7B , Vicuna-7B and others5 用能量势垒信号检测扩散语言模型的越狱
Published Sep 25
Evaluated models LLaDA-8B-Instruct , LLaDA-1.5 , Dream-v0-Instruct-7B and others4 Abstract 能量势垒把 dLLM 越狱分成掩盖初始状态或中途越垒，三个 logit 信号据此互补检测。Bach 等提出用去噪能量景观解释 masked diffusion 语言模型上的越狱，并由此得到三个免训练检测信号。 。
提出 AEGIS，用中层内部信号选择性激活后层适配器拦截音频越狱
Published Sep 24
Evaluated models Qwen2-Audio-7B , VITA-1.5 , Ultravox v0.5 and others6 提出 PALS，用潜空间平滑防御全双工语音对话的对抗扰动
Published Sep 23
Evaluated models Moshi-style agent 分析量化、剪枝与 KV 缓存压缩对推理模型越狱鲁棒性的影响
Published Sep 20
Evaluated models QwQ-32B , DeepSeek-R1-Distill-Qwen-32B , DeepSeek-R1-Distill-Llama-8B Abstract 效率压缩常使 LRM 越狱 HR 下降，作者将其归因于推理退化而非对齐增强。作者分析量化、剪枝和 KV 缓存压缩如何同时改变 LRM 的显存、推理和越狱脆弱性。 。