Translation in progress Some entries still include text in the original language.
Oct 13 · Tuesday
All papers Found 36 papers Another 215 papers do not have category tags yet and are not included in filtered results.
“
About this collection Collection in progress We are building a large AI safety paper collection to help researchers find work related to their interests. Papers are collected automatically andfiltered only for relevance to AI safety , without judging quality, novelty or reading value. The default “Annotated first” shows papers with tags or published paper analyses first. Each group is ordered by original publication date, newest first, with undated papers last. “Newest first” uses publication dates only. This order is not a quality ranking.
One-line summaries, tags and paper analyses are prepared by AI from the papers. Language models may have systematic biases and produce hallucinations.We plan to carry out human annotation and review to reduce errors in this content.
Introduces DistressBench, evaluating models' multidimensional support in crisis conversations
Published Oct 9
Evaluated models Muse Spark 1.2 , Muse Spark 1.3 , Muse Glimmer 30B and others20 Abstract The model is more restrained and acts less.DistressBench uses SSH dialogues written and revised by clinical personnel, and evaluates how much necessary care general chat models deliver according to weighted atomic criteria, rather than whether they refuse. When users disclose suicidal ideation or self-harm to a chat model, the authors consider the expected behavior to be recognizing the crisis, calibrating empathy, de-escalating, and referring to human help. Refusal-based evaluations cannot detect failing to act after recognizing the crisis.
评测编码 Agent 中相似技能共同安装对已装技能核心功能的替代
Published Oct 8
Evaluated models claude-sonnet-4-6 , claude-haiku-4-5-20251001 , claude-opus-5 and others6 Abstract 冲突藏在任务成功后面。作者对共同安装、做同一件事的良性 skill 做实证研究,用核心功能是否还在,而不是任务过不过,来看冲突。 。
提出 PatchBench-Local 协议,评测激活补丁修复越狱的局部附带损伤
Published Oct 7
Evaluated models Qwen2.5-3B-Instruct , Qwen2.5-14B-Instruct , gemma-3-4b-it and others8 Abstract 论文提出 PatchBench 与局部评估协议,揭示了激活补丁在全局能力无损下仍存局部良性退化。
测量工具调用 Agent 对显式报错与静默损坏的检测和恢复
Published Oct 7
Evaluated models claude-haiku-4.5-thinking , claude-haiku-4.5 , deepseek-r1 and others6 Abstract 作者称智能体看错误通道而非返回内容,静默损坏更少被当作问题。作者在 BFCL 多轮可执行环境上注入一次工具层故障,把注意到、改计划、恢复和重复分开记分,而不是只看任务有没有做完。
提出 AgentTime 基准,评测智能体按时长工作与估时能力
Published Oct 7
Evaluated models Fable 5.1 , GPT-5.6 Sol , GPT-6 Astra and others7 Abstract 作者把完成任务和管理所用时间分开。AgentTime 是对智能体时间自控的评测:预测任务耗时、按要求时长工作、事后估计已用时间。
提出 ParanoiaEval 评测编码智能体的不必要风险处置
Published Oct 7
Evaluated models Opus-5 , Sonnet-5 , Sonnet-4.6 and others8 Abstract 作者用证据受控任务对评测风险处置,称其普遍、独立于任务能力并降低满意度。作者提出 ParanoiaEval,并称它是编码智能体风险处置能力的首个统一基准。要解决的问题是:证据已经确定风险应如何处置之后,智能体仍可能扩大验证、增加保护或备份,而现有评测要么只看功能正确性,要么把相关行为拆开研究。做法是把 NIST 的 ATMA 落到仓库任务。
比较量化 Agent 的工具故障恢复,检验提示词与评测口径是否反转比较方向
Published Oct 6
Evaluated models Llama-3.1-8B-Instruct , Qwen2.5-7B-Instruct 提出 SWE-CC 基准,评测编码 Agent 对仓库贡献策略的遵守
Published Oct 5
Evaluated models GPT-5.6 Luna , Gemini 3.7 Flash , DeepSeek V4 Flash 0731 and others4 Abstract SWE-CC 中功能正确仍可能违规。SWE-CC 评测编码智能体是否遵守仓库贡献策略,而不只看补丁能否通过测试。
提出 ControlPed 与 HazardPed,生成可控行人危险场景并评测端到端驾驶
Published Oct 5
Evaluated models DiffusionDrive , SSR , VAD and others7 提出 RAGStress 受控基准,评测知识库退化下的 RAG
Published Oct 4
Evaluated models Claude Sonnet 4 , Claude Opus 4.6 , DeepSeek R1 and others5 Abstract 作者用 RAGStress 比较五系统。RAGStress 是知识库损坏下的 RAG 受控压力测试。作者明确不把它当作模型排行榜。
提出 SceneFactory-3D,用路况反事实评测驾驶策略的闭环安全性
Published Oct 2
Evaluated models Frozen L0 , L0-T , L1 and others5 Abstract SceneFactory-3D 固定场景只改路况。SceneFactory-3D 是 GPU 批处理的多智能体驾驶仿真器,用来在场景和控制器固定时只改路面物理,并比较闭环结果。
提出 PowerBench,测量模型对权力转移请求的拒答偏见
Published Oct 2
Evaluated models grok-4.3 , haiku-4.5 , nova-2-lite and others18 Abstract 作者报告拒答随 SE/DE/PG 变化,并存在针对美国失权、智能体和语言的差。
重测提示注入检测器在 Agent 工具输出上的检出与任务阻断
Published Oct 2
Evaluated models Horizon-Labs , Wolf Defender , Prismor-1.5B and others15 Abstract 论文揭示公开基准无法反映智能体检测器表现,检测能力源于输入格式相似而非通用防御,建议基于工具输出与低误报评测。
提出 SAGO,以语义等价变体上的逐例行为稳定性评测大模型泛化
Published Oct 1
Evaluated models Llama-3.2-3B-Instruct , Llama-3.1-8B-Instruct , Gemma-2B-IT and others11 Abstract SAGO 用多轴逐例稳定性替代聚合准确率,十一个模型都未均匀泛化,且排名会随数据集改变。SAGO 把 LLM 泛化改写成同一目标与上下文在语义等价表达下的逐例行为稳定性,而不是单一基准上的聚合准确率。 。
构建 Agent Error Dataset,把智能体自然失败转为诊断与修复训练数据
Published Oct 1
Evaluated models Qwen3-8B Abstract AED 把自然失败做成诊断与修正数据。AED 是一个面向文本智能体的错误–诊断集合,用来把失败轨迹转成可分析、可训练的诊断与修正,而不是只保留最终奖励。
提出 Drift-Bench++ 评测 Agent 在错位沟通和意图漂移下的对齐
Published Sep 30
Evaluated models DeepSeek-V4-Pro , 五个 LLM backbone(Figure 3,论文未在正文逐一列出名称) Abstract Drift-Bench++ 用可执行错位和静默漂移评测交互意图对齐,澄清有帮助但仍有差距。Drift-Bench++ 是面向 Interactive Intent Alignment 的可执行基准:智能体要在用户说错、目标会变、耐心有限时,持续跟上当前意图。
测量剪枝对语音 LLM 群体转写公平性的影响
Published Sep 30
Evaluated models Whisper Small (12 layers) , Whisper Medium (24 layers) , Whisper Large-v2 (32 layers) Abstract 剪枝后的 Speech-LLM 不能只看总体 WER:Fair-Speech 上族群差扩大,作者建议看最差组。
提出 MemoReason 基准,测量参数记忆对上下文推理的影响
Published Sep 28
Evaluated models GPT-OSS-20B , GPT-OSS-120B , OLMo-3-7B-Think and others9 Abstract 配对的虚构替换显示熟悉度影响推理,但模型很少直接抄回事实答案。MemoReason 用结构相同的事实–虚构文档配对,测量参数记忆如何影响大模型的上下文推理。
提出 AGENT BOUNDARY,用四向反事实任务评测工具智能体行动边界
Published Sep 27
Evaluated models GPT-5.5 , Claude Opus 4.8 , Gemini 3.5 Flash and others15 Abstract 四向反事实基准把过度拒绝和未授权遵从拆开,Thought 校正在十个配置上提高已授权完成。AGENT BOUNDARY 是面向工具使用 LLM 智能体的四向可执行反事实评测,并附带一个决策时 Thought 校准模块。
提出 SameFact,比较同一安全事实在判断与动作选择上的敏感度
Published Sep 26
Evaluated models Qwen3.8-27B , Mistral Small 3.2 24B , Gemma-3-27B-IT and others6 Abstract SameFact 显示同一安全事实的敏感度随模型、因子和引出协议共同变化。