Translation in progress Some entries still include text in the original language.
Oct 12 · Monday
Another 233 papers do not have category tags yet and are not included in filtered results.
“
About this collection Collection in progress We are building a large AI safety paper collection to help researchers find work related to their interests. Papers are collected automatically andfiltered only for relevance to AI safety , without judging quality, novelty or reading value. The default “Annotated first” shows papers with tags or published paper analyses first. Each group is ordered by original publication date, newest first, with undated papers last. “Newest first” uses publication dates only. This order is not a quality ranking.
One-line summaries, tags and paper analyses are prepared by AI from the papers. Language models may have systematic biases and produce hallucinations.We plan to carry out human annotation and review to reduce errors in this content.
测量并预测具身 VLM 规划器的任务拒答可变性
Published Sep 30
Evaluated models gemini-robotics-er-2-preview , gemini-robotics-er-1.6-preview Abstract 日常物体能翻转一部分已给出的拒答,可翻转程度取决于任务且可被本地代理预测。作者测量 constitution 守护的具身 VLM 规划器:一次拒答在只往场景里放一个日常物体之后还保不保持得住,并把这种易翻转程度称为任务的 malleability 。
证明无显式危害的图文窄微调可诱发跨任务涌现未对齐
Published Sep 28
Evaluated models GPT-4o , GPT-4.1 , Gemini 2.5 and others15 Abstract 证实窄多模态微调可引发全面的多渠道未对齐行为转变,揭示了后训练阶段对齐被隐蔽重塑的安全隐患。论文系统探究了视觉-语言模型中由窄任务微调诱发的跨模态涌现未对齐(Emergent Misalignment, EM)现象。
提出 VoxParity,固定转写只改音频,评测语音智能体是否按行业规则改工具调用
Published Sep 28
Evaluated models MiMo-V2.6-Pro , gemini-3.7-flash , Qwen3.8-Omni and others15 Abstract VoxParity 用固定转写的音频对比和 words-only null,测量语音智能体是否按所听内容改变工具调用。VoxParity 测量语音智能体在词语不变、只有声音改变时,是否按行业规则改它所执行的工具调用。
提出 AV-SafetyBench 评测文生音视频模型的不安全生成
Published Sep 7
Evaluated models LTX-2.3 , Ovi-1.1 , JavisDiT++ and others7 Abstract AV-SafetyBench 用三视角评五个 T2AV 模型,显示只看视频会漏掉音频与联合风险。AV-SafetyBench 是面向文本生成音视频(T2AV)的安全基准:一条提示词同时规定画面和音频,评测同时看两轨以及它们的交互。作者要测的是,不安全含义不只出现在画面上:它可以主要由语音或声音承载,也可以只有两轨合起来才成立。T2VSafetyBench 不评音频,TTA-Bench 不评与画面的交互,作者认为二者都盖不住这些路径。
提出 HazardArena 基准,用孪生场景评测 VLA 的语义安全
Published Apr 14
Evaluated models OpenVLA-OFT , π0 , NORA and others4 Abstract safe-only 微调提升良性执行,也提升匹配不安全孪生上的危险完成。HazardArena 评测 VLA 在运动要求不变时,能否因语义风险而停手。
提出 LABSHIELD,评测科学实验室智能体的安全推理与规划
Published Mar 12
Evaluated models GPT-5.2 , GPT-o3 , GPT-o4-mini and others20 提出基准 CHART HAL,细粒度评测图表理解中的幻觉
Published Sep 22, 2025
Evaluated models Gemini-2.5-Pro , GPT-5 , GPT-5-mini and others15 You have reached the end