Translation in progress Some entries still include text in the original language.
Oct 12 · Monday
All papers Found 15 papers Another 265 papers do not have category tags yet and are not included in filtered results.
“
About this collection Collection in progress We are building a large AI safety paper collection to help researchers find work related to their interests. Papers are collected automatically andfiltered only for relevance to AI safety , without judging quality, novelty or reading value. The default “Annotated first” shows papers with tags or published paper analyses first. Each group is ordered by original publication date, newest first, with undated papers last. “Newest first” uses publication dates only. This order is not a quality ranking.
One-line summaries, tags and paper analyses are prepared by AI from the papers. Language models may have systematic biases and produce hallucinations.We plan to carry out human annotation and review to reduce errors in this content.
提出 SAFESHIELD,组织小语言模型部署时的安全决策
Published Oct 6
Evaluated models Qwen3-4B-Instruct Abstract SAFESHIELD 用可审计决策轨迹组织 SLM 部署时的四项安全决策,并报告协调依赖影响端到端结果。SAFESHIELD 是面向小语言模型的部署时安全框架,把运行时安全从单项审核改写成可检查的决策过程。
提出 Persona Guardrail,强制客服智能体守住功能边界
Published Oct 2
Evaluated models Qwen3-30B-A3B , Qwen3-VL-30B , Qwen3-8B and others5 Abstract Persona Guardrail 用功能边界做同步输入输出校验,并在 PAGE 与生产延迟预算下给出评测。Persona Guardrail 是客服向智能体的同步运行时防御:先写明功能边界,再决定放行或拦截,而不是只检测某一攻击类。
提出 DART,用去噪表征转移检测多轮智能体攻击并注入提醒
Published Sep 30
Evaluated models Qwen3-8B , Qwen3-14B , Qwen3-32B and others6 提出免训练框架 SED,将有害智能体轨迹蒸馏为可检索安全策略
Published Sep 29
Evaluated models DeepSeek-V4-Flash , GLM-5.2 , Kimi K3 提出工具型 Agent 的自适应攻击 DART 与预执行防御 SAGE
Published Sep 28
Evaluated models GPT-5.6 Luna , GPT-5.6 Terra , Gemini 3.8 Flash and others5 Abstract 论文提出状态控制框架 SEAD、攻击 DART 与防御 SAGE,实验显示执行反馈与环境探测在攻防交互中具有关键作用。
提出 Skilder,按角色渐进下发企业工具并确定性拦截越权调用
Published Sep 24
Evaluated models Claude Haiku 4.5 , Qwen 3.5 122B , Gemma 4 31B and others6 Abstract Skilder 用单 MCP 服务器按角色交付工具并硬拦截。Skilder 把企业工具型智能体的能力按角色打包,经一个 MCP 服务器做渐进发现,使工具范围由服务器而不是提示词来执行。
提出 FLOWSEAL,用工具级信息流控制阻断智能体隐私泄露
Published Sep 12
Evaluated models DeepSeek-V3.2 , GPT-4.1-mini , Gemini-Flash-2.5 Abstract 作者分析大模型智能体隐私检查与攻击面重合问题,提出外部拦截防御 FLOWSEAL 并验证有效性。
为冻结模型与目标域自动搜索可部署的 Agent 安全 harness
Published Sep 5
Evaluated models Sonnet 4.6 , GLM-5 , Kimi-K2.5 and others11 提出 SafeEvolve,用轨迹证据协同演化安全 harness 与策略
Published Sep 3
Evaluated models Qwen3.5-4B , Qwen3-4B-Instruct-2507 , Qwen3.5-1.7B and others4 Abstract SafeEvolve 用轨迹证据协同更新安全 harness 和策略,在两个 4B 模型的智能体安全基准上改变安全与效用。SafeEvolve 把已完成的 on-policy 轨迹变成安全 harness 的有界更新,并用两阶段 SFT-RL 把这些更新内化进工具使用策略。
提出 SciTrace,为科学发现智能体加入跨阶段安全推理与工具轨迹核验
Published Jun 6
Evaluated models Llama-3.1-70B-Instruct , Qwen2.5-72B-Instruct , DeepSeek-V3 and others4 Abstract SciTrace 把安全推理织入科学智能体各阶段,在 SciSafetyBench 上提高安全指标并保持输出质量。SciTrace 是加在科学发现智能体流水线上的安全框架,不是再在各阶段出口放一个独立过滤器。
提出 MalURLBench 评测 Agent 是否接受结构伪装的恶意 URL
Published Jan 26
Evaluated models GPT-3.5-Turbo , GPT-4o-mini , GPT-4o and others13 提出 NeuroFilter,用激活探针过滤智能体多轮隐私攻击
Published Jan 21
Evaluated models GPT-OSS 20B , Qwen 2.5 32B Instruct , Llama 3.3 70B and others8 提出 TS-Guard 与 TS-Flow,在执行前检测并引导 Agent 修正有害工具调用
Published Jan 15
Evaluated models GPT-4o , TS-Guard , Qwen2.5-14B-Instruct Abstract TS-Bench 标步骤级风险,TS-Guard 用多任务 RL 做执行前判定,TS-Flow 用反馈代替直接中止。ToolSafe 研究 LLM 智能体在工具执行前的步骤级安全:基准 TS-Bench、护栏 TS-Guard,以及反馈驱动框架 TS-Flow。
提出 Tool Obfuscation 并评测函数调用 Agent 的攻防
Published Jan 14
Evaluated models Qwen3:8B , Llama-3.2:3B , Granite3.2:8B and others5 Defenses arXiv 2505.23559 · May 29, 2025 提出 SafeScientist 四层监控,阻止科研智能体执行高风险或不伦理任务
Published May 29, 2025
Evaluated models GPT-4o , GPT-4.1 , GPT-3.5-turbo and others5 Abstract 四层监控加科研安全基准。SafeScientist 是带四层监控的科研智能体框架,并用 SciSafetyBench 评测科学场景中的任务安全。
You have reached the end