Translation in progress Some entries still include text in the original language.
Oct 12 · Monday
Another 232 papers do not have category tags yet and are not included in filtered results.
“
About this collection Collection in progress We are building a large AI safety paper collection to help researchers find work related to their interests. Papers are collected automatically andfiltered only for relevance to AI safety , without judging quality, novelty or reading value. The default “Annotated first” shows papers with tags or published paper analyses first. Each group is ordered by original publication date, newest first, with undated papers last. “Newest first” uses publication dates only. This order is not a quality ranking.
One-line summaries, tags and paper analyses are prepared by AI from the papers. Language models may have systematic biases and produce hallucinations.We plan to carry out human annotation and review to reduce errors in this content.
Extending reinforcement learning for full-modality foundation models to support agent self-improvement
Published Oct 8
Evaluated models MiMo-V2.6-Pro , MiMo-V2.6-Flash , MiMo-V2.6-Distill-Qwen-9B Abstract The series uses three-dimensional RL and group scoring to improve agent scores; the authors claim the final performance is comparable to frontier models.MiMo-V2.6 is an all-modality MoE technical report, pursuing agent self-improvement by scaling up RL computation, environments, and scoring.
提出 comprehension audits，以人类理解证据作为继续研发门槛
Published Oct 7 Abstract 理解审计把出示人类理解设为继续研发的门禁，并报告开源评审评论率下降。本文是一份研发过程保障提案：用 comprehension audits 检验责任人是否理解 AI 参与产生的研发贡献，未达标就暂停后续开发与依赖该贡献的发布。 。
提出选择性长时程精炼，筛选轨迹以提升终端智能体训练可靠性
Published Oct 5
Evaluated models Qwen/Qwen3-8B Abstract 中间长度的监督更均衡。这项工作研究终端智能体模仿学习里，教师轨迹应保留多少 token。
评估自动化 AI 研发触发智能爆炸的可能并提出政策应对
Published Sep 29 Abstract 软件驱动智能爆炸可能把数年进展压进数月，作者要求三项政策先做好。Chan 等论证：自动化 AI 研发可能经软件反馈环形成智能爆炸，把本需数年的进展压进数月或更短。他们关心的不是换硬件的建设周期，而是 AI 扩大有效研发劳动力、再产出更强系统，以及社会能否在能力跃迁前看见、约束并适应这一过程。
提出 QPT，用奖励与成本 Q 惩罚训练满足约束的离线强化学习策略
Published Sep 28 Abstract QPT 把条件 Transformer 与奖励/成本 Q 惩罚连成训练–推理一致的安全离线 RL 方法。QPT 针对安全离线 RL：只从离线数据学习，同时处理约束满足、回报最大化和行为正则，并希望部署时更换成本阈值而无需重训。
用可验证经验流水线训练智能体并分析研发中的人机分工
Published Sep 15
Evaluated models Atria Dawn Preview Abstract Atria Dawn 在五个基准上领先，研发日志里人类仍掌握大多数最终决定。Atria Dawn Preview 是面向研究与工程流程的智能体语言模型，论文同时报告它的基准表现，以及开发它的过程中人与智能体如何分工。
提出 ERPO，用探针共识奖励在无标签代码题上做测试时强化学习
Published Sep 9
Evaluated models Qwen3-4B , Qwen3-8B 提出 OpenMLE，后训练元进化智能体并做机器学习工程长程搜索
Published Jul 31
Evaluated models Frontis-MA1-35B , Frontis-MA1-30B Abstract OpenMLE 训练 Frontis-MA1-35B，用四个共享算子把 MLE 后训练和长程搜索接成元进化闭环。作者提出全栈 OpenMLE ，在机器学习工程里研究从进化到元进化的一步，并把递归自我改进视为更远目标。智能体要在延迟、有噪声的执行反馈下反复修改程序。作者认为公开系统很少同时提供可扩展环境、基于执行的后训练，以及部署该模型的长程进化搜索。
You have reached the end