Translation in progress Some entries still include text in the original language.
Oct 12 · Monday
Another 265 papers do not have category tags yet and are not included in filtered results.
“
About this collection Collection in progress We are building a large AI safety paper collection to help researchers find work related to their interests. Papers are collected automatically andfiltered only for relevance to AI safety , without judging quality, novelty or reading value. The default “Annotated first” shows papers with tags or published paper analyses first. Each group is ordered by original publication date, newest first, with undated papers last. “Newest first” uses publication dates only. This order is not a quality ranking.
One-line summaries, tags and paper analyses are prepared by AI from the papers. Language models may have systematic biases and produce hallucinations.We plan to carry out human annotation and review to reduce errors in this content.
用纠正性监督改写固定有害微调样本,缓解涌现性失准
Published Sep 29
Evaluated models Qwen2.5-14B-Instruct , Gemma-4-12B-it Abstract 在固定毒行上,把坏回答改成正确答案比删掉更能降低 EM,正确内容比多出来的安全指令更关键。Correct, Don’t Delete 比较的是:微调数据里已经固定的有害行,是删掉还是改成同一提示上的正确答案,更能减轻 emergent misalignment。
提出几何缓解框架,把有害梯度子空间从 LoRA 更新中正交投影出去
Published Sep 28
Evaluated models Qwen2.5-3B-IT , Qwen2.5-7B-IT , Qwen2.5-14B-IT and others8 Abstract 窄域 LoRA 会留下可测的有害子空间。See it, Say it, Sorted 在参数轨迹上诊断涌现失准,并把经验有害梯度子空间从 LoRA 更新中正交去掉。
提出特征方向漂移机制与探针空间走廊正则,抑制蒸馏潜隐特质迁移
Published Sep 1
Evaluated models Qwen2.5-7B-Instruct , Llama-3.1-8B-Instruct , Gemma-3-12B-IT Abstract 论文将潜意识学习归结为特征方向漂移的持续累积,并提出走廊正则化在微调中控制隐蔽特征转移。
You have reached the end