Translation in progress Some entries still include text in the original language.
Oct 13 · Tuesday
Another 227 papers do not have category tags yet and are not included in filtered results.
“
About this collection Collection in progress We are building a large AI safety paper collection to help researchers find work related to their interests. Papers are collected automatically andfiltered only for relevance to AI safety , without judging quality, novelty or reading value. The default “Annotated first” shows papers with tags or published paper analyses first. Each group is ordered by original publication date, newest first, with undated papers last. “Newest first” uses publication dates only. This order is not a quality ranking.
One-line summaries, tags and paper analyses are prepared by AI from the papers. Language models may have systematic biases and produce hallucinations.We plan to carry out human annotation and review to reduce errors in this content.
Proposes PASAC and a five-layer boundary guarantee stack, turning agent evaluation overstepping into verifiable whole-system guarantees.
Published Oct 9 提出 Tracekit,审计编码 Agent 的意图、推理与动作并检测账本篡改
Published Sep 29
Evaluated models Claude Code (claude -p, version 2.1) , 独立评审(同一 CLI,无工具) Abstract Tracekit 把意图、自述和动作写入可锚定的哈希链。Tracekit 是无第三方依赖的编码智能体审计层:把人类请求、模型自述和已执行动作并排写入可外部锚定的哈希链,执行前用正则门,事后用规则和独立模型互查。
提出 k-robust 联盟对齐,刻画误对齐评审下的安全委托授权
Published Sep 15 Abstract 联盟覆盖使无个体对齐的评审面板仍可相对基线安全授权,数值分数改善完备性。委托授权的安全不要求每位评审者对齐,而要求面板在效用空间覆盖委托人。
评估安全监视器并提出双侧梯级微调以减少会答有害请求的漏检
Published Sep 5
Evaluated models Gemma-4-31B-IT , Qwen3-32B , Llama Guard 3 8B and others6 Abstract 论文发现安全监视器大多拦截模型已拒答请求,指出明确度偏差是共性原因,并通过双侧梯级微调提升回答请求的召回表现。
提出 ClawSentry 多层监控网关,在技能准入和运行时拦截恶意技能与隐藏指令
Published Aug 21
Evaluated models Codex/GPT-5.4 , Codex/GPT-5.5 , Claude Code/GLM-5.1 and others6 Abstract ClawSentry 用包准入、三级运行时门控和反绕过,压低 skill 攻击并保住干净任务。ClawSentry 是挂在智能体运行时之外的安全监督网关,用来同时盖住 skill 执行的多个生命周期边界,并把已被拒绝的效果记到会话里。
Proposes MTGuard, which blocks unsafe tool calls by comparing MCP call declarations with execution traces.
Published Jul 28
Evaluated models DeepSeek-V4-Flash , DeepSeek-V4-Pro , GPT-5.6 Luna 提出企业级检测系统 ADR,识别编程 Agent 的提示注入与恶意 MCP
Published May 17 Abstract 提出了端点因果遥测、两级在线分流与离线红队闭环的 ADR 系统,并在生产环境中验证了有效性。
Defenses arXiv 2505.23559 · May 29, 2025 提出 SafeScientist 四层监控,阻止科研智能体执行高风险或不伦理任务
Published May 29, 2025
Evaluated models GPT-4o , GPT-4.1 , GPT-3.5-turbo and others5 Abstract 四层监控加科研安全基准。SafeScientist 是带四层监控的科研智能体框架,并用 SciSafetyBench 评测科学场景中的任务安全。
You have reached the end