Translation in progress Some entries still include text in the original language.
Oct 12 · Monday
All papers Found 10 papers Another 233 papers do not have category tags yet and are not included in filtered results.
“
About this collection Collection in progress We are building a large AI safety paper collection to help researchers find work related to their interests. Papers are collected automatically andfiltered only for relevance to AI safety , without judging quality, novelty or reading value. The default “Annotated first” shows papers with tags or published paper analyses first. Each group is ordered by original publication date, newest first, with undated papers last. “Newest first” uses publication dates only. This order is not a quality ranking.
One-line summaries, tags and paper analyses are prepared by AI from the papers. Language models may have systematic biases and produce hallucinations.We plan to carry out human annotation and review to reduce errors in this content.
实现 DEFER，以确定性检查优先拦截多智能体流水线的内容攻击
Published Oct 6
Evaluated models Qwen3-235B-A22B-Instruct-2507 , gpt-oss-120b , Llama-4-Scout-17B-16E-Instruct and others5 Abstract DEFER 把确定性检查放在 judge 之前。DEFER 用来测量多智能体授权流水线里，确定性规则在何处结束、LLM judge 从何处开始。
提出检测、结构化与 GSPO 流程，降低共识生成的提示注入错位
Published Oct 3
Evaluated models LLaMA-2 7B , LLaMA-3 8B , GPT 3.5 Turbo and others14 Abstract 三章依次做个体偏好预测、政党知识图谱审议，以及共识生成对提示注入的脆弱性与一条防御流程。这是一篇把 LLM 数字孪生放进增强民主的博士论文，分个体表示、政党聚合和共识生成的提示注入三章。
提出 SecJev，用场景加权训练把决策模型适配为安全类型化判断
Published Oct 2
Evaluated models SecJev-0.8B , SecJev-2B , SecJev-4B and others4 Abstract SecJev 用共享打分器做安全决策，0.8B 的 task-macro 超过 Kev-9B。SecJev 是 0.8B 到 9B 的安全决策模型族，作者称据其所知是首个面向安全的 Jev-like 家族。
提出 RLCDAlignBench，零样本检测多种对齐失败
Published Sep 24
Evaluated models Jev (jev-1.13.0) Abstract 一次通用问题已能给多数对齐失败排序，大的误差来自状态和标签。RLCDAlignBench 测量用强化学习做校准决策的 Jev，能否当作对齐失败的零样本检测器。
提出生成式护栏 HiveTraceGuard-Pro，检测提示注入、越狱与混淆
Published Sep 1
Evaluated models HiveTraceGuard-Pro (0.6B) Abstract 0.6B 俄英护栏在自建俄语干净集和 PI-RU 上得分最高，聚合 key 居第三，过阻断和回复精度仍是作者标出的短板。HiveTraceGuard-Pro 是面向请求与回复审核的 0.6B 生成式护栏，由 Qwen3-0.6B 经 LoRA 微调，在俄语和英语上训练，只输出一个 safe/unsafe 裁决。
Proposes a static-first validator, CARE, that decides before dispatch whether an agent's shell command may be executed
Published Jul 22 提出 SciTrace，为科学发现智能体加入跨阶段安全推理与工具轨迹核验
Published Jun 6
Evaluated models Llama-3.1-70B-Instruct , Qwen2.5-72B-Instruct , DeepSeek-V3 and others4 Abstract SciTrace 把安全推理织入科学智能体各阶段，在 SciSafetyBench 上提高安全指标并保持输出质量。SciTrace 是加在科学发现智能体流水线上的安全框架，不是再在各阶段出口放一个独立过滤器。
Proposing a lineage-graph governance layer to suppress error cascades in multi-agent collaboration
Published Mar 4 Abstract A single seed can solidify into a false consensus along a fixed collaboration graph.The authors turn "small errors becoming collective false consensus" in LLM-MAS into a measurable propagation on a graph, and use a plug-in that only changes messages, not topology, to reduce the final infection.
Attacks arXiv 2509.05372 · Sep 4, 2025 用对抗缺陷报告诱导自动程序修复系统生成不安全补丁
Published Sep 4, 2025
Evaluated models claude-sonnet-4-20250514 , o4-mini , GPT-4.1-mini and others8 Defenses arXiv 2505.23559 · May 29, 2025 提出 SafeScientist 四层监控，阻止科研智能体执行高风险或不伦理任务
Published May 29, 2025
Evaluated models GPT-4o , GPT-4.1 , GPT-3.5-turbo and others5 Abstract 四层监控加科研安全基准。SafeScientist 是带四层监控的科研智能体框架，并用 SciSafetyBench 评测科学场景中的任务安全。
You have reached the end