Translation in progress Some entries still include text in the original language.
Oct 12 · Monday
All papers Found 16 papers Another 261 papers do not have category tags yet and are not included in filtered results.
“
About this collection Collection in progress We are building a large AI safety paper collection to help researchers find work related to their interests. Papers are collected automatically andfiltered only for relevance to AI safety , without judging quality, novelty or reading value. The default “Annotated first” shows papers with tags or published paper analyses first. Each group is ordered by original publication date, newest first, with undated papers last. “Newest first” uses publication dates only. This order is not a quality ranking.
One-line summaries, tags and paper analyses are prepared by AI from the papers. Language models may have systematic biases and produce hallucinations.We plan to carry out human annotation and review to reduce errors in this content.
提出 CARE,离线认证 VLA 加速配置的回合级失败风险并选出最快合格候选
Published Oct 7
Evaluated models OpenVLA-OFT , π0.5 , π0 and others5 Abstract CARE 以配对回合认证加速诱发失败,在预算内选最快候选,不足则保留参考。CARE 在部署前从加速配置中选出最快、且加速诱发失败风险能被有限样本认证为低于用户预算的候选。证据不足就保留全计算参考策略。
提出 AdvSim2Real,协同训练网页智能体抵御页面注入
Published Oct 7
Evaluated models Qwen3.5-4B TAPDreamer 用公开编码器做固定补丁。
Published Oct 6
Evaluated models FastWAM , DreamWAM-uncond , DreamWAM-joint and others4 提出 ControlPed 与 HazardPed,生成可控行人危险场景并评测端到端驾驶
Published Oct 5
Evaluated models DiffusionDrive , SSR , VAD and others7 提出轨迹级可迁移对抗攻击,降低深度强化学习策略的期望回报
Published Oct 5
Evaluated models DQN , Double DQN (DDQN) Abstract 轨迹级后退视界攻击在 CartPole 上比逐步 FGSM 类和 Sign 噪声更压低回报。这项工作研究 DRL 上的迁移式黑盒观测攻击 :受害参数不可访问时,在白盒代理上造扰动再迁移。
提出 Perturbot 扰动训练,打破 VLA 的模态捷径
Published Oct 3
Evaluated models π0.5 Abstract Perturbot 改训练数据以削弱三类模态捷径,GroundFscore 用来看成功是否来自任务证据。Perturbot 是一套不改推理的 VLA 训练期数据干预,用来削弱模态捷径,并用离线分数区分“任务变好”和“靠捷径变好”。
提出 WebFovea,加固视觉网页智能体的解析、执行、反馈与观察往返
Published Oct 2
Evaluated models claude-opus-4-6 提出 SceneFactory-3D,用路况反事实评测驾驶策略的闭环安全性
Published Oct 2
Evaluated models Frozen L0 , L0-T , L1 and others5 Abstract SceneFactory-3D 固定场景只改路况。SceneFactory-3D 是 GPU 批处理的多智能体驾驶仿真器,用来在场景和控制器固定时只改路面物理,并比较闭环结果。
提出 FAIL BANK,用运行时 CBF 反馈自进化更新 VLA 策略
Published Sep 30
Evaluated models π0.5 , π0 提出 UBA-ORL,以 BD/CM 样本在遗忘后激活离线 RL 后门
Published Sep 19
Evaluated models TD3+BC , BCQ , IQL Abstract UBA-ORL 用竞争的 BD/CM 样本,使离线 RL 后门在删除伪装轨迹后激活。UBA-ORL 研究离线强化学习中由合规轨迹删除激活的后门:合法贡献者同时上传共享触发的后门轨迹和伪装轨迹,训练后触发响应被压低,删除伪装批次后再升高。受害系统是使用静态数据集和轨迹级遗忘接口的离线 RL 服务。对手不能看到训练算法、参数、梯度或具体遗忘算法,但能提交可区分批次,并在部署时向观测注入预定触发。
评测安全 Agent 在对抗性任务污染下的解题成功与开销
Published Sep 17
Evaluated models Gemma-4 31B , DeepSeek-V4 Flash , GPT-OSS 120B and others6 Abstract AgentLSD 用配对 web CTF 表明,欺骗性环境证据会改变安全智能体的解题率与工作量。AgentLSD 是一个对照框架,用来测量安全智能体在任务本身不变时,对对抗性任务污染的反应。
提出 DAERT,以仿真失败为奖励生成多样对抗指令,暴露 VLA 的语言脆弱性
Published Apr 7
Evaluated models π0 , OpenVLA , OpenVLA-7B and others5 提出 SABER,用强化学习攻击器在预算内改写指令使 VLA 任务失败
Published Mar 26
Evaluated models π0-LIBERO , π0.5 , X-VLA and others6 测量任务无关说服对 Agent 编码与网页研究行为的影响
Published Feb 1
Evaluated models gpt-4.1-nano , mistral-nemo-12b , llama-3.1-8b Abstract 任务无关说服会在轨迹上留下任务相关的行为痕迹,但立场易感性不能稳定预测其幅度。这篇工作测量一件事:与任务无关的说服进入对话之后,AI 智能体执行后面的编码或网页研究时,轨迹是否系统性不同,以及“更容易被说服”能否预测差有多大。
提出 VILTA,在闭环训练中用 VLM 编辑邻车轨迹以提升驾驶策略鲁棒性
Published Jan 19 Abstract VILTA 在闭环中编辑邻车轨迹以训练驾驶策略。VILTA 是一个把视觉语言模型放进自动驾驶闭环训练的框架,用来应对长尾危险场景不足。
Attacks arXiv 2505.23266 · May 29, 2025 提出 AdvOF,生成对抗物体误导视觉语言导航智能体的场景感知
Published May 29, 2025
Evaluated models Lseg , Clip , ViT-L/16 and others5 Abstract AdvOF 以多视角融合生成对抗物体。AdvOF 是针对 VLM 驱动 VLN 服务导航的对抗物体攻击。
You have reached the end