Translation in progress Some entries still include text in the original language.
Oct 12 · Monday
Another 265 papers do not have category tags yet and are not included in filtered results.
“
About this collection Collection in progress We are building a large AI safety paper collection to help researchers find work related to their interests. Papers are collected automatically andfiltered only for relevance to AI safety , without judging quality, novelty or reading value. The default “Annotated first” shows papers with tags or published paper analyses first. Each group is ordered by original publication date, newest first, with undated papers last. “Newest first” uses publication dates only. This order is not a quality ranking.
One-line summaries, tags and paper analyses are prepared by AI from the papers. Language models may have systematic biases and produce hallucinations.We plan to carry out human annotation and review to reduce errors in this content.
提出 comprehension audits,以人类理解证据作为继续研发门槛
Published Oct 7 Abstract 理解审计把出示人类理解设为继续研发的门禁,并报告开源评审评论率下降。本文是一份研发过程保障提案:用 comprehension audits 检验责任人是否理解 AI 参与产生的研发贡献,未达标就暂停后续开发与依赖该贡献的发布。 。
评估自动化 AI 研发触发智能爆炸的可能并提出政策应对
Published Sep 29 Abstract 软件驱动智能爆炸可能把数年进展压进数月,作者要求三项政策先做好。Chan 等论证:自动化 AI 研发可能经软件反馈环形成智能爆炸,把本需数年的进展压进数月或更短。他们关心的不是换硬件的建设周期,而是 AI 扩大有效研发劳动力、再产出更强系统,以及社会能否在能力跃迁前看见、约束并适应这一过程。
勾勒科学智能体经济以协调验证、信用与安全
Published Sep 26 Abstract 作者主张以智能体经济管理自主科学发现的验证资源、信用、问责与安全,而非只提升推理。作者把高自主 AI scientist 的规模化协调写成经济与制度问题:假设生成变便宜之后,要分配的是稀缺验证资源,并处理信用、问责和恶意使用。
提出双层系统 AIDE2,使研究智能体自改进 Harness 并对比人类研发基线
Published Sep 22
Evaluated models gemini 3 flash , gpt-5.6-sol , fable 5 Abstract 提出双层递归自改进系统 AIDE2,在固定预算下演化 Harness 代码,多项留出基准超越人类基线并降低奖励黑客。
Abstract 作者主张防护优先于自主性,用三元框架把输出安全扩展到行为与环境反馈。这是一篇关于 LLM 驱动 AI scientists 的 perspective:自主科研能力增强时,误用和意外后果缺少科学情境下的系统防护。
You have reached the end