Translation in progress Some entries still include text in the original language.
Oct 12 · Monday
Another 240 papers do not have category tags yet and are not included in filtered results.
“
About this collection Collection in progress We are building a large AI safety paper collection to help researchers find work related to their interests. Papers are collected automatically andfiltered only for relevance to AI safety , without judging quality, novelty or reading value. The default “Annotated first” shows papers with tags or published paper analyses first. Each group is ordered by original publication date, newest first, with undated papers last. “Newest first” uses publication dates only. This order is not a quality ranking.
One-line summaries, tags and paper analyses are prepared by AI from the papers. Language models may have systematic biases and produce hallucinations.We plan to carry out human annotation and review to reduce errors in this content.
评测记忆门控对激活诱导与记忆诱导谄媚的防御效果
Published Oct 6
Evaluated models Llama-3.1-8B-Instruct , Qwen2.5-7B-Instruct , Mistral-7B-Instruct-v0.3 and others4 Abstract 作者称外部记忆过滤成立,数据未显示反向转向再有贡献。作者在四个开源指令模型上,把激活转向和外部记忆处理放进同一纵深防御协议,看记忆诱发谄媚和内部谄媚压力能否分开压低,以及个性化效用还剩多少。要处理的问题是:检索到的用户历史会推动模型顺从存储信念。只改外部上下文,并不直接动模型内部的谄媚表征。
提出 RAIM,用交叉拟合堆叠聚合廉价评审检测幻觉
Published Sep 30
Evaluated models Llama , Qwen , Mistral and others10 Abstract 十个廉价评审的堆叠在可采纳区间接近 Sonnet,代价主要是一次域内校准。
提出 RLCDAlignBench,零样本检测多种对齐失败
Published Sep 24
Evaluated models Jev (jev-1.13.0) Abstract 一次通用问题已能给多数对齐失败排序,大的误差来自状态和标签。RLCDAlignBench 测量用强化学习做校准决策的 Jev,能否当作对齐失败的零样本检测器。
提出 APEXA,在工具层拒绝无执行支撑的结果并拦截电机命令
Published Sep 21
Evaluated models GPT-5-mini , GPT-5.4 , Claude Opus 4.7 and others4 Abstract 作者称执行是否发生要由工具层核对,而不能只靠提示词。APEXA 是先进光子源上的数据还原框架,用工具层代码约束语言模型智能体的工具调用。
提出 k-robust 联盟对齐,刻画误对齐评审下的安全委托授权
Published Sep 15 Abstract 联盟覆盖使无个体对齐的评审面板仍可相对基线安全授权,数值分数改善完备性。委托授权的安全不要求每位评审者对齐,而要求面板在效用空间覆盖委托人。
提出 Sentinel-RL,将拓扑处置从 LLM 卸载到受约束图策略
Published Sep 4
Evaluated models HetGAT , PPO Abstract Sentinel-RL 用图编码器与 PPO 承担拓扑决策,LLM 负责叙述与门控,并在 LANL 上报告检测与时延。Sentinel-RL 是面向 SOC 的神经符号架构:拓扑决策离开 LLM,改由认证图上的 HetGAT 与 PPO 完成。
构建法律引用幻觉基准 LePhantomCite 并评测智能体核验
Published Jun 19
Evaluated models gpt-5-2025-08-07 , Opus 4.8 , Gemini 2.5 Flash and others13 Abstract 引用幻觉未随代际持续下降。法律引用核验被做成基准:伪造引用的法院文书在增加,生成端的幻觉率也没有随模型代际持续下降。
Proposing a lineage-graph governance layer to suppress error cascades in multi-agent collaboration
Published Mar 4 Abstract A single seed can solidify into a false consensus along a fixed collaboration graph.The authors turn "small errors becoming collective false consensus" in LLM-MAS into a measurable propagation on a graph, and use a plug-in that only changes messages, not topology, to reduce the final infection.
You have reached the end