Translation in progress Some entries still include text in the original language.
Oct 12 · Monday
Another 265 papers do not have category tags yet and are not included in filtered results.
“
About this collection Collection in progress We are building a large AI safety paper collection to help researchers find work related to their interests. Papers are collected automatically andfiltered only for relevance to AI safety , without judging quality, novelty or reading value. The default “Annotated first” shows papers with tags or published paper analyses first. Each group is ordered by original publication date, newest first, with undated papers last. “Newest first” uses publication dates only. This order is not a quality ranking.
One-line summaries, tags and paper analyses are prepared by AI from the papers. Language models may have systematic biases and produce hallucinations.We plan to carry out human annotation and review to reduce errors in this content.
提出 RL-ARC，用推理置信度在强化学习中校准推理模型
Published Oct 8
Evaluated models Qwen2.5-7B , Qwen3-8B , Llama-8B distilled from DeepSeek-R1 Abstract RL-ARC 用推理置信度调节答案置信度，作者称可少牺牲精度并改善 ID 与 OOD 校准。RL-ARC 是校准感知的强化学习框架，用推理过程的口头置信度调节答案置信度。
提出 VeriFine，用双环协同扩展验证以实现具身推理自我改进
Published Oct 7
Evaluated models Alpamayo 1.5 8B , Qwen3-VL 2B , Claude Opus 5 Abstract VeriFine 用双环协同演化具身推理的策略、课程和评审，驾驶与导航的策略分和评审对齐都上升。VeriFine 把驾驶和导航推理的自改进写成策略、课程和无参考评审的协同演化，用来处理固定评审跟不上新失败模式的问题。
提出 PACT，遗忘推理模型在压力下的欺骗行为并保留上下文理解
Published Sep 30
Evaluated models DeepSeek-R1-Distill-Qwen-32B , QwQ-32B Abstract 论文将大模型欺骗形式化为上下文条件行为，提出 PACT 框架在消除欺骗的同时保留了上下文遵循能力。
提出 worst-case Constrained RL，蒸馏时约束推理前缀偏离以抑制奖励作弊
Published Sep 29
Evaluated models Qwen2.5-1.5B , Llama-3.2-3B , Qwen2.5-Coder-0.5B Abstract 作者提出前缀约束蒸馏。这是把推理蒸馏写成最坏前缀约束 RL 的训练研究。 作者关心最终答案奖励下的 reward hacking，以及序列平均软惩罚允许局部偏离被其他 token 补偿的问题。
提出 ACTR，只更新安全思考神经元以对齐推理与回答的安全类别
Published Sep 29
Evaluated models Qwen3-8B , Gemma4-12B-it 提出 EOPSA，用 TRR 截断与安全类过滤做在策略自蒸馏安全对齐
Published Sep 28
Evaluated models Qwen3-1.7B , Qwen3-4B , Qwen3-14B and others5 用门控 IoU 与 RadGraph 的 GRPO 降低胸片报告幻觉
Published Sep 26
Evaluated models Qwen3-VL-8B-GRPO 提出 TAME，在强化学习中抑制模板激活以缓解思维链混淆
Published Sep 21
Evaluated models Qwen3-VL-8B , Gemma-3-12B-it 提出 GASP 对抗自博弈训练，使推理模型抵御可错上下文
Published Jan 30
Evaluated models DeepSeek-R1-Distill-Qwen-1.5B , DeepScaleR-1.5B , Qwen3-4B and others4 Abstract GASP 用对抗自博弈和分布内修复引导，提升四个开源模型在可错上下文下的推理表现。GASP 是只用终答对错做奖励的后训练方法，目标是让已经会解题的开源推理模型，在条件上下文被局部损坏或轻度扰动时检测并修复。
You have reached the end