Translation in progress Some entries still include text in the original language.
Oct 13 · Tuesday
Another 215 papers do not have category tags yet and are not included in filtered results.
“
About this collection Collection in progress We are building a large AI safety paper collection to help researchers find work related to their interests. Papers are collected automatically andfiltered only for relevance to AI safety , without judging quality, novelty or reading value. The default “Annotated first” shows papers with tags or published paper analyses first. Each group is ordered by original publication date, newest first, with undated papers last. “Newest first” uses publication dates only. This order is not a quality ranking.
One-line summaries, tags and paper analyses are prepared by AI from the papers. Language models may have systematic biases and produce hallucinations.We plan to carry out human annotation and review to reduce errors in this content.
Proposes the FAITH safe filtering reinforcement learning framework, training high-dimensional systems to optimize task reward under constraints
Published Oct 9 Abstract FAITH separates safety filtering from reward optimization.FAITH is a model-free safe filtering reinforcement learning framework for high-dimensional systems: safety correction and task reward reside in separate modules.
提出 SIGMA，让模型依据 Model Spec 自造对齐数据并改进安全对齐
Published Oct 6
Evaluated models Qwen3.6-27B Abstract SIGMA 用 Model Spec 自造监督，单轮训练可迁到多项智能体安全指标。SIGMA 让 Qwen3.6-27B 只凭 Model Spec 和高层领域，自己生产对齐任务、评分细则和奖励。
提出 VICS-G 可行未来解码，重排冻结 VLA 策略的动作候选
Published Oct 4
Evaluated models SafeVLA (task-optimized / base) , SafeVLA (safety-aligned / safe) Abstract 作者用可行未来解码重排冻结 VLA 的下一步，并称 VICS-G 降低观测代价且完成率接近策略采样。训练无关解码器 VICS 在冻结 VLA 的推理阶段重排动作块，使当前选择带上该动作仍可能留下的安全完成质量。
提出 SafeStage 基准，分阶段评测视觉语言机器人操作的物理安全
Published Sep 18
Evaluated models π0.5 , GR00T N1.7 , DreamZero and others4 提出量化条件后门 AGENTQ，使智能体仅在量化后触发恶意工具调用
Published Sep 13
Evaluated models Qwen3.5-2B , Qwen3.5-4B , Qwen3.5-9B and others6 Abstract 论文研究了智能体量化条件后门风险，提出 AGENTQ 在保持效用的同时实现全精度隐蔽与量化后生效。
提出 TrojanWorld，用物理触发器对世界模型智能体植入想象引导后门
Published Sep 7
Evaluated models TD-MPC2 , DreamerV3 , R2-Dreamer Abstract TrojanWorld 揭示了世界模型智能体的供应链后门风险，通过在世界模型中操纵想象可实现对闭环动作的持续控制。
提出 HazardArena 基准，用孪生场景评测 VLA 的语义安全
Published Apr 14
Evaluated models OpenVLA-OFT , π0 , NORA and others4 Abstract safe-only 微调提升良性执行，也提升匹配不安全孪生上的危险完成。HazardArena 评测 VLA 在运动要求不变时，能否因语义风险而停手。
Propose a structured JSON backdoor that triggers malicious actions in robot control via a poisoned LoRA
Published Apr 5
Evaluated models Llama-3.1-8B-Instruct , Gemma-2-9B-IT , DeepSeek-R1-Distill-Llama-8B and others4 You have reached the end