Translation in progress Some entries still include text in the original language.
Oct 13 · Tuesday
All papers Found 26 papers Another 201 papers do not have category tags yet and are not included in filtered results.
“
About this collection Collection in progress We are building a large AI safety paper collection to help researchers find work related to their interests. Papers are collected automatically andfiltered only for relevance to AI safety , without judging quality, novelty or reading value. The default “Annotated first” shows papers with tags or published paper analyses first. Each group is ordered by original publication date, newest first, with undated papers last. “Newest first” uses publication dates only. This order is not a quality ranking.
One-line summaries, tags and paper analyses are prepared by AI from the papers. Language models may have systematic biases and produce hallucinations.We plan to carry out human annotation and review to reduce errors in this content.
Propose KVeil, which adds perturbations to face videos to prevent unauthorized customization from reproducing identity
Published Oct 9
Evaluated models Wan2.2-TI2V-5B , HunyuanVideo-1.5 , Kling 3.0 and others4 Abstract KVeil adapts LETHE's reference-reading disruption to the challenge's two stages, ranking first on the leaderboard in both Final columns.
Proposes LGWM, using an action-conditioned world model to verify GUI agent screen transitions.
Published Oct 8
Evaluated models LGWM 提出 OrthoPurify,用正交投影清除视觉语言模型适配器中的劫持方向
Published Oct 7
Evaluated models LLaVA-1.5-7B , Qwen3-VL-8B , LLaVA-1.5-13B and others5 Abstract 一次投影去掉劫持方向。OrthoPurify 是部署前的 LVLM 后门净化方法,用一次正交投影去掉被劫持的权重更新方向。
提出 MFOTL 离线时序验证以监控工具 Agent 的危险动作链
Published Oct 7 Abstract 形式化验证可有效识别多步攻击,但其有效性高度依赖轨迹的可信历史记录。这篇论文对工具调用大语言模型智能体的安全监控进行了形式化时序验证研究。
提出 Secure-CUA,用动作事务约束计算机使用智能体的不可信影响
Published Oct 7
Evaluated models Claude Opus 5 , Gemini 3.8 Flash , GPT-5.6-Sol Abstract Secure-CUA 用每步事务约束不可信影响,良性 TSR 接近 Vanilla-CUA。Secure-CUA 要限制图形界面里不可信内容对 CUA 决策和 GUI 执行的影响,同时保留合法任务所需的不可信信息。
提出 WebMirage,用局部对抗图像劫持视觉网页 Agent 的浏览器操作
Published Oct 7
Evaluated models LLaVA-v1.5-13B , LLaVA-v1.6-34B , MiniCPM-o-8B and others6 Abstract 论文提出了针对网络智能体的端到端视觉红队框架 WebMirage,揭示了从视觉定位到浏览器执行的安全脆弱性。WebMirage 是一个面向视觉定位网络智能体的流水线感知端到端红队攻击框架。
用 DIBench 评测移动 GUI 智能体被 UI 注入后的决策完整性
Published Sep 29
Evaluated models Qwen2.5-VL(32B) , Qwen3-VL(32B) , GUI-Owl(32B) and others7 Abstract 论文提出移动智能体决策完整性基准 DIBench,发现欺诈 UI 注入诱导目标选择并推高完成率,通用防御收益不稳定。
提出 Tracekit,审计编码 Agent 的意图、推理与动作并检测账本篡改
Published Sep 29
Evaluated models Claude Code (claude -p, version 2.1) , 独立评审(同一 CLI,无工具) Abstract Tracekit 把意图、自述和动作写入可锚定的哈希链。Tracekit 是无第三方依赖的编码智能体审计层:把人类请求、模型自述和已执行动作并排写入可外部锚定的哈希链,执行前用正则门,事后用规则和独立模型互查。
构建 ACE 语料,评测内核级证据对 Agent 攻击检测的有效性
Published Sep 24
Evaluated models AdaBoost , XGBoost , TabPFN and others10 Abstract ACE 用配对的内核与应用层证据表明,syscall 痕迹可判别智能体攻击,两层组合通常更好。ACE 是一份把智能体会话的内核 syscall 痕迹与应用层清单、转录配对起来的检测语料和基准。 。
提出 ODPure,在输入阶段用腐蚀重建与共识净化目标检测后门
Published Sep 23
Evaluated models YOLOv5 , Faster R-CNN 提出 FreqDoor,在频域混合振幅并对生成式 VLM 做训练时视觉后门
Published Sep 7
Evaluated models BLIP-2 (opt-2.7b) , InstructBLIP (flan-t5-xl) , LLaVA (interleave-qwen) Abstract FreqDoor 用频域振幅混合给三款 VLM 植入仅视觉的训练时后门。FreqDoor 是针对生成式 VLM 的仅视觉、训练时后门:在频域混合触发源振幅、保留干净图像相位,使触发在空间上分散。
提出持续学习下的净化与选择性恢复框架,抵御逐任务训练投毒后门
Published Sep 6
Evaluated models ViT-B/16 Abstract 作者报告任务内净化与恢复可配合动态专家防御后门,但保证依赖分离条件。这是一项面向持续图像分类的后门防御研究 :模型只使用当前任务数据,同时需要保留过去知识并避免学习恶意监督。
提出 TRIM,在黑盒推理时定位并净化图像后门区域
Published Sep 3
Evaluated models ResNet-50 提出 Mind2Web-Injection 评测网页 Agent 视觉注入护栏
Published Sep 2
Evaluated models GPT-5.6-luna , Qwen3-VL-32B , Qwen3-VL-8B and others6 Abstract 作者称检测、定位和反事实响应在六个 VLM 上可分开。Mind2Web-Injection 用来检查网页截图护栏的判决是否对齐到该用的画面证据。 。
提出 RACER,用区域感知一致性对抗微调去除多模态大模型后门
Published Aug 25
Evaluated models LLaVA-1.5-7B , Qwen2-VL-7B , Qwen2.5-VL-7B 提出 TC-UAP,用身份级多帧扰动保护视频免被定制复现身份
Published Jul 15
Evaluated models LTX-2.3 , Wan2.2-5B Abstract TC-UAP 以可复用的时间一致扰动干扰两类定制共用的 VAE 隐空间。作者要解决的是:发布前如何给视频加不可见扰动,使片段既不能被拿去微调视频扩散模型,也不能被抽帧做 image-to-video。
提出 VPH 与 VTH,只改视频帧劫持世界模型并投毒下游策略
Published Jun 8
Evaluated models Cosmos-Predict 2.5 , Cosmos-Predict 2.5 AC , Dino WM and others4 Abstract 只改视频帧经世界模型投毒。只改看似安全的视频帧,经世界模型之后才改变下游机器人策略。 问题在于世界模型进入数据生成后,数据集检查看到的仍是安全演示,合成轨迹却可以变危险。
构造可通过计费审计的 token 虚报,使服务商系统性超收
Published May 28
Evaluated models PALACE domain-adapted auditor Abstract 不诚实提供方可在三种 token 审计上虚报并通过检查,作者认为需改用提供方不控制的证据。不透明 LLM 的按 token 计费里,现有审计核验的是提供方可控的证据,不诚实提供方可以虚报并通过检查。 。
Conduct adversarial attacks on product images for open-source visual shopping agents and induce wrong purchases
Published Mar 17
Evaluated models LLaVA-v1.5-7B , Qwen2.5-VL-7B Abstract The authors state that LLaVA is easily induced by three attacks to buy the wrong item, while Qwen's correct purchase rate remains close to its clean condition.The authors compare the robustness of two open-source VLM shopping agents against image adversarial perturbations in a self-built e-commerce environment.
Proposes inference-time defense ICON, which detects attention over-focusing and redirects to correct indirect prompt injection in agents.
Published Feb 24
Evaluated models Qwen-3-8B , Llama-3.1-8B , Mistral-8B and others6 Abstract ICON detects over-focusing and redirects at inference time to balance IPI safety and task utility.ICON detects attention over-focusing from IPI at inference time and redirects, avoiding refusal that would terminate the agent trajectory.