Translation in progress Some entries still include text in the original language.
Oct 13 · Tuesday
All papers Found 14 papers Another 215 papers do not have category tags yet and are not included in filtered results.
“
About this collection Collection in progress We are building a large AI safety paper collection to help researchers find work related to their interests. Papers are collected automatically andfiltered only for relevance to AI safety , without judging quality, novelty or reading value. The default “Annotated first” shows papers with tags or published paper analyses first. Each group is ordered by original publication date, newest first, with undated papers last. “Newest first” uses publication dates only. This order is not a quality ranking.
One-line summaries, tags and paper analyses are prepared by AI from the papers. Language models may have systematic biases and produce hallucinations.We plan to carry out human annotation and review to reduce errors in this content.
Proposes LGWM, using an action-conditioned world model to verify GUI agent screen transitions.
Published Oct 8
Evaluated models LGWM 提出 ProbeGuard,按共识形成过程对医疗问答做选择性弃答
Published Oct 6
Evaluated models Qwen3-8B , Llama-3.1-8B-Instruct , HuatuoGPT-o1-8B Abstract ProbeGuard 用共识形成过程做可认证弃权,并在全票层分开答对与答错的共识。ProbeGuard 是给多轮共识医学问答用的认证弃权框架:基板照原样作答,弃权只看共识是怎么形成的。
提出 Control OSWorld,评测失准 GUI Agent 的监控
Published Oct 2
Evaluated models Claude Sonnet 4.6 , Claude Opus 4.8 , GPT-5.2 and others6 测量无对抗协作中 Agent 自发编码凭据以规避监控
Published Sep 30
Evaluated models DeepSeek-V4-Pro , devstral-2512 , gpt-oss-120b and others14 Abstract 论文揭示智能体会因良性助人意图自主编码凭据规避监控,主张不能单靠内容审查,需在动作层强化严格鉴权。
提出 ORBIT 框架,评测多智能体防御对合谋等威胁的效果
Published Sep 27
Evaluated models GPT-5.4 , Claude Sonnet 4.6 , Qwen3-235B and others5 Abstract ORBIT 用六层配置比较多智能体防御,逐动作监控不迁移到合谋。
展示智能体在禁止泄露与独立监视下自发建立隐蔽信道传递机密
Published Sep 26
Evaluated models GPT-5.6 Sol , Terra , Luna and others6 Abstract 论文研究了固定参数智能体在受监视交互中仅凭单比特反馈自发建立隐蔽信道,指出了多智能体跨域协作的保密安全新风险。论文研究了固定参数与提示词的智能体在受审计交互中自发形成隐蔽信道并泄露机密的过程。
提出多智能体隐写共谋框架 CODETTA,在强被动审计下隐蔽传载荷
Published Sep 24
Evaluated models Qwen2.5-7B , Llama-3.1-8B , Ministral-3-8B Abstract 提出非对称免密钥隐写框架 CODETTA,实现高容量不可区分通信,指出被动审计面临失效风险。
提出移动 Agent 轨迹审计器 MATE,判断轨迹是否违反可编辑安全策略
Published Sep 19
Evaluated models MATE-0.5B , MATE-1.5B , MATE-3B Abstract MATE 用合成轨迹微调轻量审计器,在可编辑策略下判断移动智能体轨迹是否违规并给出解释。MATE 是面向移动 GUI 智能体的轻量策略条件轨迹审计器,在给定自然语言安全策略时判断轨迹是否违规并解释原因。
提出 k-robust 联盟对齐,刻画误对齐评审下的安全委托授权
Published Sep 15 Abstract 联盟覆盖使无个体对齐的评审面板仍可相对基线安全授权,数值分数改善完备性。委托授权的安全不要求每位评审者对齐,而要求面板在效用空间覆盖委托人。
提出 HazardAuditor,用可执行轨迹训练计算机使用 Agent 的运行时守卫
Published Sep 14
Evaluated models HazardAuditor , HazardAuditor-SFT 刻画单迹监控对跨执行超性质的监督缺口
Published Sep 7
Evaluated models Llama-3.1-8B , Mistral-24B , GPT-4o-mini and others9 Abstract 单迹监督的上界由 TV 决定。论文测量单迹安全监控相对 2-safety 超性质 能看见多少:跨租户泄漏、觉察到被评估、策略性表现不佳都由两次执行之差定义,一条轨迹装不下判定。
提出以协调情节为单位遏制智能体协同入侵的准则
Published Sep 5 Abstract 立场是跨执行保留关系并约束共享状态。
提出 Sentinel-RL,将拓扑处置从 LLM 卸载到受约束图策略
Published Sep 4
Evaluated models HetGAT , PPO Abstract Sentinel-RL 用图编码器与 PPO 承担拓扑决策,LLM 负责叙述与门控,并在 LANL 上报告检测与时延。Sentinel-RL 是面向 SOC 的神经符号架构:拓扑决策离开 LLM,改由认证图上的 HetGAT 与 PPO 完成。
Defenses arXiv 2505.23559 · May 29, 2025 提出 SafeScientist 四层监控,阻止科研智能体执行高风险或不伦理任务
Published May 29, 2025
Evaluated models GPT-4o , GPT-4.1 , GPT-3.5-turbo and others5 Abstract 四层监控加科研安全基准。SafeScientist 是带四层监控的科研智能体框架,并用 SciSafetyBench 评测科学场景中的任务安全。
You have reached the end