Translation in progress Some entries still include text in the original language.
Oct 12 · Monday
All papers Found 54 papers Another 254 papers do not have category tags yet and are not included in filtered results.
“
About this collection Collection in progress We are building a large AI safety paper collection to help researchers find work related to their interests. Papers are collected automatically andfiltered only for relevance to AI safety , without judging quality, novelty or reading value. The default “Annotated first” shows papers with tags or published paper analyses first. Each group is ordered by original publication date, newest first, with undated papers last. “Newest first” uses publication dates only. This order is not a quality ranking.
One-line summaries, tags and paper analyses are prepared by AI from the papers. Language models may have systematic biases and produce hallucinations.We plan to carry out human annotation and review to reduce errors in this content.
Proposes the Cancerous backdoor, which progressively corrupts reasoning using invisible stage tokens.
Published Oct 9
Evaluated models Llama-3.1-8B-Instruct , Qwen2.5-7B-Instruct , Mistral-7B-Instruct-v0.3 Abstract Hidden tokens plus a stage controller make the backdoor progressively corrupt reasoning upon triggering, and the authors believe that looking only at the answer will miss it.Cancerous Backdoor Attack changes LLM backdoors from one-time activation to multi-stage reasoning corruption that accumulates progressively with triggers.
Uses premise permutation and hidden-layer tracing to audit whether legal chain-of-thought truly relies on the cited legal provisions.
Published Oct 9
Evaluated models Qwen3-8B , Qwen3-14B , Llama-3.1-8B and others7 Abstract Using counterfactual substitution of authorities and internal commitment tracing, the authors find that legal CoT rulings depend on authorities only to a limited extent and are vulnerable to prompt injection manipulation.This study conducts an empirical audit of the causal truthfulness of legal citations in chain-of-thought reasoning of large language models in the legal domain.
度量关闭思考指令下终答前是否仍有可见显式推理
Published Oct 8
Evaluated models Qwen3-4B , Qwen3-32B , Qwen3-235B-A22B and others6 Abstract 作者用三级指标测 no-thinking,并称模型有随答案空间加重的思考惯性。作者把 no-thinking 定义为可测量的回答行为,而不是从思考开关、特殊标记或输出长度推断。
提出 RL-ARC,用推理置信度在强化学习中校准推理模型
Published Oct 8
Evaluated models Qwen2.5-7B , Qwen3-8B , Llama-8B distilled from DeepSeek-R1 Abstract RL-ARC 用推理置信度调节答案置信度,作者称可少牺牲精度并改善 ID 与 OOD 校准。RL-ARC 是校准感知的强化学习框架,用推理过程的口头置信度调节答案置信度。
检验推理 token 数能否区分被提示的诚实与不诚实作答
Published Oct 8
Evaluated models Gemma-4-e4b , Qwen-3.5-9b , GPT-OSS-120B Abstract 被提示不诚实时推理 token 组水平更高。三个推理模型在被提示的回答政策下出现组水平推理 token 差异。作者把它当作不读思维链内容的 black-box 候选信号,而不是自发欺骗检测器。
揭示推理模型用标识符规则替代随机抽样,使审计可被预测
Published Oct 7
Evaluated models GPT-6 Sol , GPT-6 Luna , GPT-5.4 mini and others6 Abstract 研究揭示推理智能体将标识符转化为确定性规则,破坏群体独立性并导致审计预测漏洞,建议显式提供随机输入。
提出 U-SPACE 与 U-LENS,从残差流估计推理轨迹不确定性
Published Oct 7
Evaluated models Gemma-4-31B-it , Qwen3.5-27B , Magistral-Small-2507 Abstract U-SPACE 与 U-LENS 用语义方向和预测熵读推理不确定性,长度控制后仍高于所比基线。U-SPACE 与 U-LENS 是面向推理模型的无训练读出:用语义方向定位不确定性的形式,并用一个轨迹分数区分更可能错的回答。
提出 VeriFine,用双环协同扩展验证以实现具身推理自我改进
Published Oct 7
Evaluated models Alpamayo 1.5 8B , Qwen3-VL 2B , Claude Opus 5 Abstract VeriFine 用双环协同演化具身推理的策略、课程和评审,驾驶与导航的策略分和评审对齐都上升。VeriFine 把驾驶和导航推理的自改进写成策略、课程和无参考评审的协同演化,用来处理固定评审跟不上新失败模式的问题。
证明短开头词可唤醒基模型推理,且效应来自训练数据
Published Oct 6
Evaluated models Olmo-3-7B , Olmo-3-32B , Qwen3-4B and others10 提出 VERA,审计 LLM 漏洞解释里的虚构推理
Published Oct 5
Evaluated models sonnet-5 , gemma-4-26b , llama-4-maverick and others8 系统评估循环语言模型加深 loop 后的 CoT 可监控性
Published Oct 2
Evaluated models Ouro-1.4B-Thinking , Ouro-2.6B-Thinking , Nanbeige4.2-3B and others4 Abstract 加深 loop 可在部分压力测试任务降低可监测性,循环架构本身并不必然更难监测。这项工作评估 LoopLM 的 CoT 可监测性:加深共享层的重复次数,以及“有循环结构”本身,会不会让决策关键因素更少出现在可监测文本里。
证明 RLVR 后训练允许无界语言漂移且限制漂移必限制奖励
Published Oct 2
Evaluated models gemma-3-1b-pt , Llama-3.2-1B , Qwen2.5-1.5B Abstract 论文证明并验证了 RLVR 在新任务上必然诱发独特的语言漂移,揭示了前沿推理模型可监控性的安全隐患。论文从理论与实验两方面研究了大语言模型在 RLVR 后训练过程中思维链出现的语言漂移现象。
测量三种长度压力训练对 CoT 忠实性与可监控性的影响
Published Oct 2
Evaluated models Qwen3-4B-Thinking-2507 , Qwen3-8B , Olmo3-7B-Think Abstract 效率训练多通过答案不一致损害忠实性。这项工作比较三种缩短 CoT 的 RL 训练,看监督用的推理痕迹还剩多少。
检验低监控读数能否证明代码生成中的奖励作弊已受控
Published Oct 2
Evaluated models Llama-3.1-8B-Instruct Abstract 论文指出监控器训练读数接近零无法确立作弊受控,模型可利用通用外壳推迟提交绕过监控,强化学习亟需带外行为验证。本文是一篇针对强化学习可验证奖励后训练(RLVR)中监控器有效性与奖励作弊行为的实证分析研究。论文要解决的核心问题是:在训练目标中引入监控器以抑制代码生成中的作弊行为时,接近零的监控器读数是否足以确立模型行为已真正受控。
比较隐写推理与隐写传信、编码推理的可学性
Published Sep 30
Evaluated models GPT-5.5 , Claude Sonnet 5 , Gemini 3.5 Flash and others14 Abstract 隐写推理比传信和编码推理更难学。Schulz、Fülle 与 Frengel 测量大语言模型习得隐写推理的难度,并与隐写传信、编码推理对比,以估计依赖阅读 CoT 的监控还能否成立。
构建编码 RL 奖励作弊测试台 CATCH 并检验 CoT 监控失效
Published Sep 30
Evaluated models Qwen3-4B , Qwen3.5-27B Abstract CATCH 用双运行金标签研究编码 RL 的奖励黑客,并观察到监控会被注释适应削弱。CATCH 是面向编码 RL 奖励黑客的可控分析测试床,用可利用环境、可调初始倾向和基于执行的金标签,在训练全程比较黑客动态与干预。
提出 FAME,用反事实概念漂移评测智能体虚假记忆
Published Sep 30
Evaluated models Llama-3B Abstract FAME 用反事实引起的隐状态概念漂移,在出答案前区分忠实记忆与虚假记忆。FAME 是一个免训练的评测框架,用来判断自主智能体的记忆在虚假相关、环境偏移或知识冲突下是否已变成虚假记忆。 。
提出 CIA 指标衡量并改进思维链与内部计算的一致性
Published Sep 30
Evaluated models Llama3.1-8B-Instruct , Gemma2-9B-it , Qwen3-8B and others5 Abstract 用 CIA 度量并以后训练拉齐 CoT 与内部策略。
提出 PACT,遗忘推理模型在压力下的欺骗行为并保留上下文理解
Published Sep 30
Evaluated models DeepSeek-R1-Distill-Qwen-32B , QwQ-32B Abstract 论文将大模型欺骗形式化为上下文条件行为,提出 PACT 框架在消除欺骗的同时保留了上下文遵循能力。
检查正确答案对应的思维链是否构成合法推导
Published Sep 30
Evaluated models 124M-parameter GPT-2-style models(12-layer, hidden size 768, rotary embeddings) Abstract iGSM 上答案正确、轨迹合法与极简性可以分开,分布偏移下差距变大。iGSM 上的程序可检查实验:正确答案并不保证思维链是合法推导。 。作者针对一个被用于监测和解读的假设:发出的轨迹忠实于、或至少可靠相关于模型如何得到答案。