Translation in progress Some entries still include text in the original language.
Oct 12 · Monday
Another 254 papers do not have category tags yet and are not included in filtered results.
“
About this collection Collection in progress We are building a large AI safety paper collection to help researchers find work related to their interests. Papers are collected automatically andfiltered only for relevance to AI safety , without judging quality, novelty or reading value. The default “Annotated first” shows papers with tags or published paper analyses first. Each group is ordered by original publication date, newest first, with undated papers last. “Newest first” uses publication dates only. This order is not a quality ranking.
One-line summaries, tags and paper analyses are prepared by AI from the papers. Language models may have systematic biases and produce hallucinations.We plan to carry out human annotation and review to reduce errors in this content.
构建 EvoRiskBench 评测工作区 Agent 的运行时安全风险
Published Oct 2
Evaluated models GPT-5.6 Sol , DeepSeek-V4-Pro-0813 , Claude Opus 5 Abstract 论文构建了工作空间智能体运行时风险基准 EvoRiskBench，发现高执行力智能体在 IPI 下面临较高安全风险。
提出 ORBIT 框架，评测多智能体防御对合谋等威胁的效果
Published Sep 27
Evaluated models GPT-5.4 , Claude Sonnet 4.6 , Qwen3-235B and others5 Abstract ORBIT 用六层配置比较多智能体防御，逐动作监控不迁移到合谋。
提出 Emergence World，对长时程多智能体系统开展对抗压力测试
Published Sep 15
Evaluated models Claude Opus 4.8 , DeepSeek v4 Pro , Gemini 3.5 Flash and others9 Abstract 作者通过长期平行世界实验指出模型对齐不具备可组合性，单模型群体会产生社会奉承、协同退缩及语言不透明等失效。
提出 PMPA，经外部源向 Agent 持久记忆投毒并跨会话泄露隐私
Published Sep 12
Evaluated models DeepSeek-V4-Flash , DeepSeek-V4-Pro , Qwen3-Max Abstract 论文提出了持久记忆投毒攻击 PMPA，报告了 harness 智能体在处理外部数据时易受跨会话记忆投毒与隐私泄露的风险。
复现 AgentCF 上的多智能体攻防并刻画连通性作用
Published Aug 4
Evaluated models Qwen3-235B-A22B , Claude Haiku 4.5 , Mixtral 8×7B and others4 Abstract 连通性沿 k 与ρ改变攻防，且用户/物品与早期/稳态需要分开看。作者在 AgentCF 上研究连通性如何改变多智能体协同过滤的攻防，复现已有方法而不是提出新载荷。
提出 GeoDetect 以几何分数检测视觉语言预训练模型的对抗样本
Published Jul 16
Evaluated models CLIPViT (ViT-B/16) , CLIPCNN (ResNet-50) , ALBEF and others4 Abstract GeoDetect 用几何分数检测 VLP 对抗样本。GeoDetect 是面向视觉-语言预训练模型的对抗样本检测方法，用嵌入几何而不是任务 logits 区分干净样本与对抗样本。
提出 PaperGuard，用图文注入与梯度扰动抬高自动审稿分数并检测恶意指令
Published Jun 11
Evaluated models Claude-sonnet-4.5 , GPT-4o , GPT-4.1 and others11 Abstract PaperGuard 测到提示注入与白盒视觉抬分，并比较分块检索防御。PaperGuard 同时评测并检测多模态 AI 审稿中的评分操纵。
建模并利用多智能体网络中子智能体生成时的记忆继承漏洞
Published May 9
Evaluated models MiniMax M2.5 , Llama-4-Maverick-17B-128E-Instruct-FP8 , Qwen3.5-Plus and others5 Abstract 形式化子智能体继承，在 OpenClaw 上演示四类编排层漏洞并提出防御。作者对多智能体网络里的子智能体继承 做形式化分析，并用开源框架上的 PoC 演示编排层如何让单点妥协继续扩散。
Defenses arXiv 2505.23559 · May 29, 2025 提出 SafeScientist 四层监控，阻止科研智能体执行高风险或不伦理任务
Published May 29, 2025
Evaluated models GPT-4o , GPT-4.1 , GPT-3.5-turbo and others5 Abstract 四层监控加科研安全基准。SafeScientist 是带四层监控的科研智能体框架，并用 SciSafetyBench 评测科学场景中的任务安全。
You have reached the end