Translation in progress Some entries still include text in the original language.
Oct 12 · Monday
Another 233 papers do not have category tags yet and are not included in filtered results.
“
About this collection Collection in progress We are building a large AI safety paper collection to help researchers find work related to their interests. Papers are collected automatically andfiltered only for relevance to AI safety , without judging quality, novelty or reading value. The default “Annotated first” shows papers with tags or published paper analyses first. Each group is ordered by original publication date, newest first, with undated papers last. “Newest first” uses publication dates only. This order is not a quality ranking.
One-line summaries, tags and paper analyses are prepared by AI from the papers. Language models may have systematic biases and produce hallucinations.We plan to carry out human annotation and review to reduce errors in this content.
用 CDPG 与 BTM 追踪思考如何改变反事实公平翻转
Published Sep 25
Evaluated models QwQ-32B , DeepSeek-R1-Distill-Qwen-32B , Qwen3-32B and others5 提出 SCHEMA,用概念图与轨迹分评测科学 Agent 幻觉
Published Aug 1
Evaluated models Kimi-K2.5 , Qwen3.6-Plus , Llama-4-Scout and others10 Abstract SCHEMA 用知识拓扑评估科学智能体幻觉,终答正确仍可能来自有缺陷的中间推理。SCHEMA 是面向科学智能体幻觉的证据锚定评测框架,实例化在生物医学的 Protein Domain 与 PathVQA-Enhanced。作者在摘要中称它是首个同时做到证据锚定和拓扑感知的此类框架。
提出价值泄漏评估,测量模型回答受自身价值倾向的隐蔽影响
Published Jul 16
Evaluated models Claude Opus 4.8 , Claude Opus 4.7 , Claude Opus 4.6 and others15 Abstract 论文揭示前沿模型回答常受自身价值隐蔽塑造,提出反事实评估量化偏见及其思维链隐瞒,指出当前对齐未能有效防范该失效。
提出 KidnapRAG,用投毒文档黑盒劫持 Agentic RAG 的推理链
Published Jul 1
Evaluated models Qwen2.5-32B-Instruct , Llama-3.3-70B-Instruct , QwQ-32B and others5 Abstract 顺序投毒可把多步推理拖向指定应答,作者称关键在持续引导而非单次注入。KidnapRAG 是针对 Agentic RAG 的 black-box 语料投毒:攻击者不能访问模型、提示词、检索器或私有轨迹,只能发布可能被检索的文档,并利用公开界面上的推理与搜索查询。
Proposes AdversarialCoT single-document retrieval poisoning to manipulate RAG reasoning answers
Published Apr 14
Evaluated models DeepSeek-R1 , Qwen3 , GLM4.5 and others5 用简历中的不可见指令做间接提示注入,操纵招聘推荐
Published Feb 20
Evaluated models Qwen 3 30B A3B Instruct 2507 , Qwen 3 30B A3B Thinking 2507 Abstract 作者称推理在简单注入下会帮攻击圆谎,在不合逻辑的复杂注入下又会把欺骗漏出来。
You have reached the end