Translation in progress Some entries still include text in the original language.
Oct 12 · Monday
All papers Found 83 papers Another 262 papers do not have category tags yet and are not included in filtered results.
“
About this collection Collection in progress We are building a large AI safety paper collection to help researchers find work related to their interests. Papers are collected automatically andfiltered only for relevance to AI safety , without judging quality, novelty or reading value. The default “Annotated first” shows papers with tags or published paper analyses first. Each group is ordered by original publication date, newest first, with undated papers last. “Newest first” uses publication dates only. This order is not a quality ranking.
One-line summaries, tags and paper analyses are prepared by AI from the papers. Language models may have systematic biases and produce hallucinations.We plan to carry out human annotation and review to reduce errors in this content.
Proposes the Cancerous backdoor, which progressively corrupts reasoning using invisible stage tokens.
Published Oct 9
Evaluated models Llama-3.1-8B-Instruct , Qwen2.5-7B-Instruct , Mistral-7B-Instruct-v0.3 Abstract Hidden tokens plus a stage controller make the backdoor progressively corrupt reasoning upon triggering, and the authors believe that looking only at the answer will miss it.Cancerous Backdoor Attack changes LLM backdoors from one-time activation to multi-stage reasoning corruption that accumulates progressively with triggers.
Uses premise permutation and hidden-layer tracing to audit whether legal chain-of-thought truly relies on the cited legal provisions.
Published Oct 9
Evaluated models Qwen3-8B , Qwen3-14B , Llama-3.1-8B and others7 Abstract Using counterfactual substitution of authorities and internal commitment tracing, the authors find that legal CoT rulings depend on authorities only to a limited extent and are vulnerable to prompt injection manipulation.This study conducts an empirical audit of the causal truthfulness of legal citations in chain-of-thought reasoning of large language models in the legal domain.
度量关闭思考指令下终答前是否仍有可见显式推理
Published Oct 8
Evaluated models Qwen3-4B , Qwen3-32B , Qwen3-235B-A22B and others6 Abstract 作者用三级指标测 no-thinking,并称模型有随答案空间加重的思考惯性。作者把 no-thinking 定义为可测量的回答行为,而不是从思考开关、特殊标记或输出长度推断。
提出 RL-ARC,用推理置信度在强化学习中校准推理模型
Published Oct 8
Evaluated models Qwen2.5-7B , Qwen3-8B , Llama-8B distilled from DeepSeek-R1 Abstract RL-ARC 用推理置信度调节答案置信度,作者称可少牺牲精度并改善 ID 与 OOD 校准。RL-ARC 是校准感知的强化学习框架,用推理过程的口头置信度调节答案置信度。
检验推理 token 数能否区分被提示的诚实与不诚实作答
Published Oct 8
Evaluated models Gemma-4-e4b , Qwen-3.5-9b , GPT-OSS-120B Abstract 被提示不诚实时推理 token 组水平更高。三个推理模型在被提示的回答政策下出现组水平推理 token 差异。作者把它当作不读思维链内容的 black-box 候选信号,而不是自发欺骗检测器。
揭示推理模型用标识符规则替代随机抽样,使审计可被预测
Published Oct 7
Evaluated models GPT-6 Sol , GPT-6 Luna , GPT-5.4 mini and others6 Abstract 研究揭示推理智能体将标识符转化为确定性规则,破坏群体独立性并导致审计预测漏洞,建议显式提供随机输入。
提出 Persist-3 序贯检验,从隐藏表示识别未见越狱源
Published Oct 7
Evaluated models Llama2-7B-chat , Qwen2.5-7B-Instruct , Gemma-2-9B-it and others4 Abstract Persist-3 用有限窗口检验攻击流是否超出已知越狱源,检出率低于全历史 SR-DKW,但决策只依赖最近观测。Persist-3 是一个有限记忆的序贯检测器,用来判断攻击表示流是否已经不能由任何一个已知越狱源解释。 。
提出 U-SPACE 与 U-LENS,从残差流估计推理轨迹不确定性
Published Oct 7
Evaluated models Gemma-4-31B-it , Qwen3.5-27B , Magistral-Small-2507 Abstract U-SPACE 与 U-LENS 用语义方向和预测熵读推理不确定性,长度控制后仍高于所比基线。U-SPACE 与 U-LENS 是面向推理模型的无训练读出:用语义方向定位不确定性的形式,并用一个轨迹分数区分更可能错的回答。
AI summary 研究者提出一种轻量级路由 logits 安全检测器,在提示词预填充阶段读取 MoE 视觉语言模型的专家路由信号,在生成前判断多模态请求是否安全,且不修改模型参数或专家路由。
Published Oct 6
Evaluated models Qwen3-VL-30B-A3B-Instruct , Kimi-VL-A3B-Instruct Abstract 读出而非操纵 router logits,可在不改模型的情况下降低两模型的组合式安全错误。作者在两个指令微调 MoE VLM 上比较改模型与读路由。组合式风险按 HoliSafe 分成五类:图文各自可安全,合在一起才不安全,或不安全内容只在图像里。
提出 ProbeGuard,按共识形成过程对医疗问答做选择性弃答
Published Oct 6
Evaluated models Qwen3-8B , Llama-3.1-8B-Instruct , HuatuoGPT-o1-8B Abstract ProbeGuard 用共识形成过程做可认证弃权,并在全票层分开答对与答错的共识。ProbeGuard 是给多轮共识医学问答用的认证弃权框架:基板照原样作答,弃权只看共识是怎么形成的。
证明短开头词可唤醒基模型推理,且效应来自训练数据
Published Oct 6
Evaluated models Olmo-3-7B , Olmo-3-32B , Qwen3-4B and others10 提出 PyINE 基准,训练捷径跟随模型并比较监督者
Published Oct 4
Evaluated models shortcut-following model organism , gpt-4o , gpt-5 and others12 Abstract PyINE 用可验证代码执行研究捷径失败的监督覆盖与成本权衡。PyINE 是用可执行程序研究推理模型引出与监督的框架,PyINE-v1 是其第一次发布。
系统评估循环语言模型加深 loop 后的 CoT 可监控性
Published Oct 2
Evaluated models Ouro-1.4B-Thinking , Ouro-2.6B-Thinking , Nanbeige4.2-3B and others4 Abstract 加深 loop 可在部分压力测试任务降低可监测性,循环架构本身并不必然更难监测。这项工作评估 LoopLM 的 CoT 可监测性:加深共享层的重复次数,以及“有循环结构”本身,会不会让决策关键因素更少出现在可监测文本里。
用分类后缀提升激活探针对分布外恶意输入的检测
Published Oct 2
Evaluated models Llama-3.1-8B , Qwen3.5-9B , Gemma-4-12B Abstract 作者称排序增益来自分类格式,低 FPR 精度来自点名准则。用户轮后的分类后缀,被作者用作激活探针的分布外检测干预:排序看格式,低 FPR 精度看是否点名恶意/良性。
证明 RLVR 后训练允许无界语言漂移且限制漂移必限制奖励
Published Oct 2
Evaluated models gemma-3-1b-pt , Llama-3.2-1B , Qwen2.5-1.5B Abstract 论文证明并验证了 RLVR 在新任务上必然诱发独特的语言漂移,揭示了前沿推理模型可监控性的安全隐患。论文从理论与实验两方面研究了大语言模型在 RLVR 后训练过程中思维链出现的语言漂移现象。
测量三种长度压力训练对 CoT 忠实性与可监控性的影响
Published Oct 2
Evaluated models Qwen3-4B-Thinking-2507 , Qwen3-8B , Olmo3-7B-Think Abstract 效率训练多通过答案不一致损害忠实性。这项工作比较三种缩短 CoT 的 RL 训练,看监督用的推理痕迹还剩多少。
比较隐写推理与隐写传信、编码推理的可学性
Published Sep 30
Evaluated models GPT-5.5 , Claude Sonnet 5 , Gemini 3.5 Flash and others14 Abstract 隐写推理比传信和编码推理更难学。Schulz、Fülle 与 Frengel 测量大语言模型习得隐写推理的难度,并与隐写传信、编码推理对比,以估计依赖阅读 CoT 的监控还能否成立。
提出 CIA 指标衡量并改进思维链与内部计算的一致性
Published Sep 30
Evaluated models Llama3.1-8B-Instruct , Gemma2-9B-it , Qwen3-8B and others5 Abstract 用 CIA 度量并以后训练拉齐 CoT 与内部策略。
提出 PACT,遗忘推理模型在压力下的欺骗行为并保留上下文理解
Published Sep 30
Evaluated models DeepSeek-R1-Distill-Qwen-32B , QwQ-32B Abstract 论文将大模型欺骗形式化为上下文条件行为,提出 PACT 框架在消除欺骗的同时保留了上下文遵循能力。
用持续更新的探针做微调,降低有害性并保持线性可监测性
Published Sep 30
Evaluated models Mistral 7B Instruct v0.1 , Llama 3 8B Instruct Abliterated , Qwen3-14B Abstract 持续重拟合的探针可降低有害性、提高诚实性,训练后概念仍能被线性探针读出。Probe-guided fine-tuning 把探针分数当作唯一对齐信号,用来推动 harmlessness 与 honesty,并检查训练后这些概念是否仍线性可读。