Translation in progress Some entries still include text in the original language.
Oct 12 · Monday
All papers Found 11 papers Another 255 papers do not have category tags yet and are not included in filtered results.
“
About this collection Collection in progress We are building a large AI safety paper collection to help researchers find work related to their interests. Papers are collected automatically andfiltered only for relevance to AI safety , without judging quality, novelty or reading value. The default “Annotated first” shows papers with tags or published paper analyses first. Each group is ordered by original publication date, newest first, with undated papers last. “Newest first” uses publication dates only. This order is not a quality ranking.
One-line summaries, tags and paper analyses are prepared by AI from the papers. Language models may have systematic biases and produce hallucinations.We plan to carry out human annotation and review to reduce errors in this content.
Auditing LLM judge reliability and defining trustworthy verdict rate and accuracy upper bound
Published Oct 8
Evaluated models GPT-5.2 , GPT-4o , Gemini-2.5-Pro and others6 Abstract The authors claim that comparing judges should look at T, not just accuracy.The authors audit whether LLM-as-a-Judge decisions can still be treated as actionable ground truth under repeated queries, swapped candidate order, and changed prompt formats.
揭示类型化决策模型按选项标签而非定义规则作答
Published Oct 2
Evaluated models laya-typed-decisions , laya , laya-multilingual and others9 Abstract 揭示类型化决策模型被标签误导的机理,证实源于提示词渲染并给出实操建议。
揭示安全路由评测在分布偏移下的虚假下限与选择偏差
Published Oct 1
Evaluated models claude-3-5-sonnet , claude-3-opus , claude-sonnet-4-6 and others9 Abstract 论文揭示安全路由评估在分布偏移下的虚假下限,指出防御重心应转向外部动作级强制。
分析隐蔽推理在思维链监控下的信息足迹下界与不可读性
Published Sep 29
Evaluated models Qwen2.5-7B-Instruct , Llama-3.1-8B-Instruct , Qwen 3.5 397B-A17B and others12 Abstract 论文从理论与实证探明了思维链监控的边界:复杂隐蔽计算必然泄露信息足迹且需承担长度税,但该足迹可被在线加密而不可读。
诊断护栏相对基座在对抗提示上的置信失校
Published Sep 29
Evaluated models Llama-Guard 7B , Llama-Guard-2 8B , Llama-Guard-3 8B and others10 Abstract 对抗包装使 guard 高置信漏检,而对应 base 在同一输入上常更不确定。诊断性分析 :五个提示词分类 guard 的置信度,在清洁输入上可以较校准,在越狱包装后则变成高置信度的错误判定。
提出 RewardExplainer,用反事实偏好反馈学习奖励模型解释
Published Sep 28
Evaluated models FsfairX-LLaMA3-RM-v0.1 , Skywork-Reward-V2-Qwen3-1.7B , RM-Mistral-7B and others6 Abstract RewardExplainer 用双向反事实反馈训练 RM 解释器,并用以发现偏差、定向微调原 RM。RewardExplainer 针对只输出标量的判别式奖励模型,训练一个可复用的自然语言机制解释器,并把解释接到偏差发现与 RM 微调上。
用五阶段蒙特卡洛分析奖励作弊如何导致 Agent 围堵失效
Published Sep 26 Abstract 分层控制的模拟事件率低于弱控制以及单独隔离或单独监控。这项研究用蒙特卡洛把奖励黑客接到外部安全事件上,比较的是控制组合,不是 Hugging Face 事件的再现概率。
分析稀疏重叠下 LLM judge 与人类一致性的验证误差并规划重叠分配
Published Sep 26
Evaluated models Gemini Flash , Gemini Pro , GPT-4o-mini and others10 Abstract 稀疏重叠主导 judge 验证的错误决策。这篇工作研究标注重叠很稀时,怎样验证 LLM judge 是否足以替代人类,并规划重叠该留多少、怎么分配。 。部署前的标准做法是在校准集上比较 judge 与人类的一致性。
归纳开放式医学长答案检索核验的失败分类
Published Sep 25
Evaluated models GPT-5.4 , Mistral Small 3 (24B-Instruct-2501) , Mistral Small 4 (119B-2603) and others8 Abstract 作者把开放式低召回归为证据是否在库、能否被定位,以及与声明是否对齐。这篇工作诊断开放式医学事实核验的 retrieve-then-verify 管线断在哪里,而不是提出新的核验器。
提出 harm laundering,证明安全训练改写而非消除性别歧视
Published Sep 18
Evaluated models gpt2 , gpt2-medium , gpt2-large and others15 Abstract GPT 谱系上毒性下降与表征伤害上升并存。Wyer、Black 与 Al Moubayed 用 OpenAI GPT 谱系检验:毒性分数下降是否等于歧视减少。 他们的答案是否定的,并把“显性伤害被改写成评测指标看不见的形式”称为 harm laundering。
刻画单迹监控对跨执行超性质的监督缺口
Published Sep 7
Evaluated models Llama-3.1-8B , Mistral-24B , GPT-4o-mini and others9 Abstract 单迹监督的上界由 TV 决定。论文测量单迹安全监控相对 2-safety 超性质 能看见多少:跨租户泄漏、觉察到被评估、策略性表现不佳都由两次执行之差定义,一条轨迹装不下判定。
You have reached the end