Translation in progress Some entries still include text in the original language.
Oct 12 · Monday
Another 265 papers do not have category tags yet and are not included in filtered results.
“
About this collection Collection in progress We are building a large AI safety paper collection to help researchers find work related to their interests. Papers are collected automatically andfiltered only for relevance to AI safety , without judging quality, novelty or reading value. The default “Annotated first” shows papers with tags or published paper analyses first. Each group is ordered by original publication date, newest first, with undated papers last. “Newest first” uses publication dates only. This order is not a quality ranking.
One-line summaries, tags and paper analyses are prepared by AI from the papers. Language models may have systematic biases and produce hallucinations.We plan to carry out human annotation and review to reduce errors in this content.
分析记忆与泛化如何决定机器遗忘的 retain 损伤
Published Oct 6
Evaluated models one-layer ReLU transformer , one-layer transformer (BMA, width doubled) , Hubble-8B-100B perturbed and others6 Abstract 作者称共享规则占比越高,遗忘带来的 retain damage 越大。作者考察学习方式如何左右 unlearning 的 retain damage:训练越依赖跨样本共享的解法,在匹配的遗忘程度上,retain 上的损失越大。
因果分解自生成反馈如何破坏测试时训练的长时程适应
Published Oct 4
Evaluated models 125M TTT-E2E , 760M TTT-E2E , 3B TTT-E2E and others5 Abstract 自写闭环损害真实文本预测。持久测试时更新若来自模型自己生成的文本,会同时改变模型和后续训练文本。作者在 PG-19 长流上分解这条闭环,并用独立文本决定是否提交更新。
提出预训练缩放律,估计野生 AI 网页文本相当于多少人类 token
Published Oct 1
Evaluated models nanochat 19.9M , 35.8M , 86.2M and others7 Abstract wild AI 文本对数据不足的模型先降损失,对高人类预算几乎立刻升损失。作者测量未标注的 wild AI 网页文本对预训练的影响,并提出一个能让 AI token 价值变号的缩放律。
证明预训练投毒的清洁超额风险指数随极限顺序变化
Published Sep 26
Evaluated models OLMo-style models Abstract 投毒清洁超额风险的幂指数取决于先固定宽高比还是先取充足数据极限。可解的预训练数据投毒理论:清洁超额风险的缩放指数随极限顺序改变。 。
You have reached the end