Translation in progress Some entries still include text in the original language.
Oct 12 · Monday
Another 233 papers do not have category tags yet and are not included in filtered results.
“
About this collection Collection in progress We are building a large AI safety paper collection to help researchers find work related to their interests. Papers are collected automatically andfiltered only for relevance to AI safety , without judging quality, novelty or reading value. The default “Annotated first” shows papers with tags or published paper analyses first. Each group is ordered by original publication date, newest first, with undated papers last. “Newest first” uses publication dates only. This order is not a quality ranking.
One-line summaries, tags and paper analyses are prepared by AI from the papers. Language models may have systematic biases and produce hallucinations.We plan to carry out human annotation and review to reduce errors in this content.
提出 STAR-Guard 双层防御,抑制长程 Agent 遗忘跨轮安全约束
Published Oct 2
Evaluated models GPT-5.5 , DeepSeek-V4-Pro , GLM-5.2 and others7 Abstract 揭示 GHOST 跨轮约束遗忘风险,构建 SCARBench 基准并通过 STAR-Guard 双层防御消除违规。
提出 IntentFlux 测量 Agent 意图漂移并提出 StateForge 修复
Published Sep 26
Evaluated models Claude Opus 4.7 , DeepSeek V4 Pro , Gemini 3.5 Flash and others9 Abstract INTENTFLUX 量化意图漂移,STATEFORGE 用显式状态部分缩小差距,但未回到单轮水平。这篇工作把“用户改口后,过时意图仍影响答案或工具动作”做成可评分的多轮失败,并试验在生成前显式维护活跃状态。
提出 TAME 调节 Agent 测试时记忆演化,并用 Trust-Memevo 评测可信度
Published Feb 3
Evaluated models Qwen3-32B , GPT-5.2 Abstract TAME 在共享记忆上同时调节效用与信任。TAME 针对测试时记忆演化中的 Agent Memory Misevolution:良性任务只按成败保留经验时,任务表现可以上升,安全、隐私、公平等可信度下降或随领域波动。
提出 VIGIL 先验证后提交,防御 Agent 工具流注入
Published Jan 9
Evaluated models Qwen3-max , Gemini-2.5-pro Abstract VIGIL 用意图约束下的提交前验证处理工具流注入。VIGIL 用 verify-before-commit 处理智能体的工具流注入,并配有基准 SIREN。
提出 BrowseSafe,在工具输出边界检测并拦截浏览器 Agent 提示注入
Published Nov 26, 2025
Evaluated models Qwen3-30B-A3B-Instruct-2507 , Qwen3-8B , PromptGuard-2 (22M) and others10 提出 SciGuard 外部护栏与 SciMT 基准,控制化学科学 AI 误用
Published Dec 12, 2023
Evaluated models SciGuard (GPT-4) , SciGuard (Gemini) , SciGuard (Mixtral) and others5 Abstract SciGuard 以外部智能体控制化学 AI 误用。这篇工作把化学科学 AI 的误用控制做成外部智能体,而不是改模型权重。作者担心合成规划、毒性预测和科学语言模型被用来获取有害物质信息、规避监管或传播危险知识,同时合法工业用途又不能靠一律拒绝来处理。SciGuard 由 LLM 担任中介,把原则和指南放进短期记忆,把分子库、危害库、法规和交互历史放进可检索的长期记忆,再按 Chain of Thought 调用 Chemprop、LocalRetro 等工具,或用 RAG 补法规片段,最后回答、追问或拒绝。
You have reached the end