Translation in progress Some entries still include text in the original language.
Oct 12 · Monday
All papers Found 14 papers Another 240 papers do not have category tags yet and are not included in filtered results.
“
About this collection Collection in progress We are building a large AI safety paper collection to help researchers find work related to their interests. Papers are collected automatically andfiltered only for relevance to AI safety , without judging quality, novelty or reading value. The default “Annotated first” shows papers with tags or published paper analyses first. Each group is ordered by original publication date, newest first, with undated papers last. “Newest first” uses publication dates only. This order is not a quality ranking.
One-line summaries, tags and paper analyses are prepared by AI from the papers. Language models may have systematic biases and produce hallucinations.We plan to carry out human annotation and review to reduce errors in this content.
Proposes the FAITH safe filtering reinforcement learning framework, training high-dimensional systems to optimize task reward under constraints
Published Oct 9 Abstract FAITH separates safety filtering from reward optimization.FAITH is a model-free safe filtering reinforcement learning framework for high-dimensional systems: safety correction and task reward reside in separate modules.
提出 SOUL 稀疏特征策略遗忘,缓解 VLA 状态幻觉
Published Oct 7
Evaluated models OpenVLA , π0.5 Abstract SOUL 以稀疏特征遗忘 VLA 状态幻觉。SOUL 用稀疏特征引导的策略 unlearning 处理 VLA 的 state hallucination。
提出 VeriFine,用双环协同扩展验证以实现具身推理自我改进
Published Oct 7
Evaluated models Alpamayo 1.5 8B , Qwen3-VL 2B , Claude Opus 5 Abstract VeriFine 用双环协同演化具身推理的策略、课程和评审,驾驶与导航的策略分和评审对齐都上升。VeriFine 把驾驶和导航推理的自改进写成策略、课程和无参考评审的协同演化,用来处理固定评审跟不上新失败模式的问题。
测量有损投机解码的安全代价,并提出 SecureSD 收紧早期验证
Published Oct 7
Evaluated models Qwen3-8B , Qwen3-32B , Llama-3.1-8B-Instruct and others6 Abstract 有损推测解码的早期偏离更快抬高越狱与注入风险。作者研究有损推测解码在换取速度时,是否会比效用更快地损害越狱与提示注入防护,并给出按位置校正的 SecureSD。
提出 SIGMA,让模型依据 Model Spec 自造对齐数据并改进安全对齐
Published Oct 6
Evaluated models Qwen3.6-27B Abstract SIGMA 用 Model Spec 自造监督,单轮训练可迁到多项智能体安全指标。SIGMA 让 Qwen3.6-27B 只凭 Model Spec 和高层领域,自己生产对齐任务、评分细则和奖励。
提出基于决策前隐藏状态的检测与引导,预测并抑制智能体欺骗
Published Oct 5
Evaluated models Qwen3-14B Abstract 论文展示了智能体自发欺骗可在行为显现前由内部表征预测,并通过激活引导证实了表征的行为可操作性。
提出 VICS-G 可行未来解码,重排冻结 VLA 策略的动作候选
Published Oct 4
Evaluated models SafeVLA (task-optimized / base) , SafeVLA (safety-aligned / safe) Abstract 作者用可行未来解码重排冻结 VLA 的下一步,并称 VICS-G 降低观测代价且完成率接近策略采样。训练无关解码器 VICS 在冻结 VLA 的推理阶段重排动作块,使当前选择带上该动作仍可能留下的安全完成质量。
提出 Perturbot 扰动训练,打破 VLA 的模态捷径
Published Oct 3
Evaluated models π0.5 Abstract Perturbot 改训练数据以削弱三类模态捷径,GroundFscore 用来看成功是否来自任务证据。Perturbot 是一套不改推理的 VLA 训练期数据干预,用来削弱模态捷径,并用离线分数区分“任务变好”和“靠捷径变好”。
提出条件特征抑制防御,检出对抗补丁后抑制 VLA 内部特征
Published Oct 2
Evaluated models π0.5 , SmolVLA Abstract 条件抑制与 patch 相关的 SAE 特征,间歇攻击下可提高 SR,持续攻击下则不能。
提出 AuraForge,从漏洞修复合成安全测试并训练编码 Agent
Published Oct 1
Evaluated models Qwen3.5-4B , GLM 4.7 Flash , Qwen3-Coder-Next and others7 Abstract AuraForge 用攻击效果测试和防泄露环境做成 AuraGym,合成监督的误拒更低,训出的 4B 模型增益高于人工测试。AuraForge 把真实仓库的历史漏洞修复变成可执行训练任务,用来监督编程智能体同时满足功能请求和隐含的安全要求。
提出 FAIL BANK,用运行时 CBF 反馈自进化更新 VLA 策略
Published Sep 30
Evaluated models π0.5 , π0 提出 ReSAIL,用选择蒸馏与特权保留缓解智能体自蒸馏崩塌
Published Sep 30
Evaluated models Qwen3-4B , Qwen3-8B , Qwen3-VL-4B-Instruct 提出 PHIRL,用进度标注对齐逆强化学习奖励
Published Sep 26
Evaluated models PHIRL , PHIRL-online Abstract PHIRL 用进度四维对齐 AIRL 奖励。PHIRL 用进度标注修正从示范反推的奖励,以减少真人在环,同时不把示范中的每一步都当成任务进展。
提出 VILTA,在闭环训练中用 VLM 编辑邻车轨迹以提升驾驶策略鲁棒性
Published Jan 19 Abstract VILTA 在闭环中编辑邻车轨迹以训练驾驶策略。VILTA 是一个把视觉语言模型放进自动驾驶闭环训练的框架,用来应对长尾危险场景不足。
You have reached the end