Translation in progress Some entries still include text in the original language.
Oct 12 · Monday
Another 240 papers do not have category tags yet and are not included in filtered results.
“
About this collection Collection in progress We are building a large AI safety paper collection to help researchers find work related to their interests. Papers are collected automatically andfiltered only for relevance to AI safety , without judging quality, novelty or reading value. The default “Annotated first” shows papers with tags or published paper analyses first. Each group is ordered by original publication date, newest first, with undated papers last. “Newest first” uses publication dates only. This order is not a quality ranking.
One-line summaries, tags and paper analyses are prepared by AI from the papers. Language models may have systematic biases and produce hallucinations.We plan to carry out human annotation and review to reduce errors in this content.
提出 DFI 与 DFC 蒸馏，定罪隐瞒失配的教师或安全提取能力
Published Oct 8
Evaluated models Llama-3.3-70B-Instruct (AuditBench SFT/KTO organisms) , Llama-3.3-70B-Instruct (DFI distilled student) , Llama-3.1-8B-Instruct (DFI distilled student) and others4 Abstract 概括了论文针对隐瞒失配模型提出的 DFI 与 DFC 机制、主实验发现及适用边界。
提出 FBS Debate 协议，使诚实为占优策略且最坏情况正确
Published Oct 2 Abstract FBS 辩论用 fbs 约束敏感分解，给出最坏情况占优策略，并匹配黑盒查询下界。FBS Debate 是一套可扩展监督的辩论规则：两名计算方争论一个可递归分解的是非问题，人类只在最后选出的子问题上做黑盒判断。要处理的缺口是，prover-estimator debate 虽能覆盖稳定分解，但只在输入分布的平均意义下成立，而且 Bob 的获胜策略一般要跟着 Alice 的作弊策略变。作者要在同一问题类上，让每个错误实例都能被抓住，并让诚实且正确成为双方的占优策略。
提出 HackProbe，黑盒检测并免疫自演化中的奖励作弊
Published Sep 4 Abstract 黑盒探针检测自演化奖励黑客，并以带宽受限重选回收真实能力。HackProbe 是挂在自演化循环上的黑盒监控器，用来发现奖励黑客并改选候选。
提出 CHERRL 注入裁判偏差以复现奖励作弊，并用 RHDA 检测训练起点
Published Jun 3
Evaluated models Qwen3-4B , Qwen3.5-plus , Qwen3.5-397B-A17B and others4 Abstract CHERRL 注入已知偏差以观察奖励黑客，并用于分析偏差和评测起点检测器 RHDA。CHERRL 是 rubric-based RL 的可控环境，用来复现奖励黑客、观察奖励分歧，并给检测器提供起点参照。
提出 ARA，读取奖励模型激活并门控 RLHF 奖励以缓解奖励作弊
Published Feb 2
Evaluated models Llama-2-7B , Llama-3.1-8B , Qwen-2.5-7B Abstract ARA 用奖励模型内部表示检出利用，并在 RLHF 里按 Auditor 概率压低代理奖励。ARA 是一套两阶段的 RLHF 审计：先对冻结奖励模型找出利用回复，再在策略优化时按检出概率压低奖励。
You have reached the end