Translation in progress Some entries still include text in the original language.
Oct 13 · Tuesday
Another 211 papers do not have category tags yet and are not included in filtered results.
“
About this collection Collection in progress We are building a large AI safety paper collection to help researchers find work related to their interests. Papers are collected automatically andfiltered only for relevance to AI safety , without judging quality, novelty or reading value. The default “Annotated first” shows papers with tags or published paper analyses first. Each group is ordered by original publication date, newest first, with undated papers last. “Newest first” uses publication dates only. This order is not a quality ranking.
One-line summaries, tags and paper analyses are prepared by AI from the papers. Language models may have systematic biases and produce hallucinations.We plan to carry out human annotation and review to reduce errors in this content.
提出 SIGMA,让模型依据 Model Spec 自造对齐数据并改进安全对齐
Published Oct 6
Evaluated models Qwen3.6-27B Abstract SIGMA 用 Model Spec 自造监督,单轮训练可迁到多项智能体安全指标。SIGMA 让 Qwen3.6-27B 只凭 Model Spec 和高层领域,自己生产对齐任务、评分细则和奖励。
测量并预测具身 VLM 规划器的任务拒答可变性
Published Sep 30
Evaluated models gemini-robotics-er-2-preview , gemini-robotics-er-1.6-preview Abstract 日常物体能翻转一部分已给出的拒答,可翻转程度取决于任务且可被本地代理预测。作者测量 constitution 守护的具身 VLM 规划器:一次拒答在只往场景里放一个日常物体之后还保不保持得住,并把这种易翻转程度称为任务的 malleability 。
证明无显式危害的图文窄微调可诱发跨任务涌现未对齐
Published Sep 28
Evaluated models GPT-4o , GPT-4.1 , Gemini 2.5 and others15 Abstract 证实窄多模态微调可引发全面的多渠道未对齐行为转变,揭示了后训练阶段对齐被隐蔽重塑的安全隐患。论文系统探究了视觉-语言模型中由窄任务微调诱发的跨模态涌现未对齐(Emergent Misalignment, EM)现象。
用 abliteration 消融代码 LLM 拒答方向,分离拒答与漏洞注入能力
Published Jun 4
Evaluated models Qwen2.5-Coder-Instruct 3B , Qwen2.5-Coder-Instruct 7B , Qwen2.5-Coder-Instruct 14B Abstract 拒答可用低秩编辑去掉,CWE-89 注入是否成功仍由模型规模决定。这项初步可行性研究用 abliteration 把代码 LLM 的拒答和 CWE 注入能力拆开:意愿可以被低秩编辑解锁,注入是否成功仍看参数规模。
You have reached the end