Translation in progress Some entries still include text in the original language.
Oct 12 · Monday
All papers Found 13 papers Another 240 papers do not have category tags yet and are not included in filtered results.
“
About this collection Collection in progress We are building a large AI safety paper collection to help researchers find work related to their interests. Papers are collected automatically andfiltered only for relevance to AI safety , without judging quality, novelty or reading value. The default “Annotated first” shows papers with tags or published paper analyses first. Each group is ordered by original publication date, newest first, with undated papers last. “Newest first” uses publication dates only. This order is not a quality ranking.
One-line summaries, tags and paper analyses are prepared by AI from the papers. Language models may have systematic biases and produce hallucinations.We plan to carry out human annotation and review to reduce errors in this content.
Proposes the FAITH safe filtering reinforcement learning framework, training high-dimensional systems to optimize task reward under constraints
Published Oct 9 Abstract FAITH separates safety filtering from reward optimization.FAITH is a model-free safe filtering reinforcement learning framework for high-dimensional systems: safety correction and task reward reside in separate modules.
测量有损投机解码的安全代价，并提出 SecureSD 收紧早期验证
Published Oct 7
Evaluated models Qwen3-8B , Qwen3-32B , Llama-3.1-8B-Instruct and others6 Abstract 有损推测解码的早期偏离更快抬高越狱与注入风险。作者研究有损推测解码在换取速度时，是否会比效用更快地损害越狱与提示注入防护，并给出按位置校正的 SecureSD。
提出基于决策前隐藏状态的检测与引导，预测并抑制智能体欺骗
Published Oct 5
Evaluated models Qwen3-14B Abstract 论文展示了智能体自发欺骗可在行为显现前由内部表征预测，并通过激活引导证实了表征的行为可操作性。
提出 VICS-G 可行未来解码，重排冻结 VLA 策略的动作候选
Published Oct 4
Evaluated models SafeVLA (task-optimized / base) , SafeVLA (safety-aligned / safe) Abstract 作者用可行未来解码重排冻结 VLA 的下一步，并称 VICS-G 降低观测代价且完成率接近策略采样。训练无关解码器 VICS 在冻结 VLA 的推理阶段重排动作块，使当前选择带上该动作仍可能留下的安全完成质量。
分析文本水印在 RAG 中诱发事实幻觉的机制并提出干预
Published Oct 4
Evaluated models LLaMA 3.1 8B Instruct , Mistral-7B-Instruct-v0.3 , Qwen2.5-14B-Instruct Abstract 论文揭示了生产环境文本水印导致模型事实退化的失效模式，分析了解码机制并提出针对性干预。论文研究生产级文本水印对大语言模型事实准确性的影响，分析了水印诱发幻觉的失效模式并评估了针对性缓解方案。
提出条件特征抑制防御，检出对抗补丁后抑制 VLA 内部特征
Published Oct 2
Evaluated models π0.5 , SmolVLA Abstract 条件抑制与 patch 相关的 SAE 特征，间歇攻击下可提高 SR，持续攻击下则不能。
提出 KPI，用入度定位跨层关键路径并做 SAE 转向以解决知识冲突
Published Sep 8
Evaluated models Llama-3-8B , Llama-3.1-8B , Gemma-2-9B Abstract KPI 以入度关键路径替代大批 SAE 特征转向，在冲突 RAG 上提高忠实并减轻副作用。KPI 针对知识冲突 RAG 中的 SAE 转向：相关性批量改特征会带入冗余，少量因果上关键的特征即可完成转向。
提出 ConflictGuard，引导 GUI Agent 在冲突指令下终止执行
Published Sep 3
Evaluated models UI-Venus-1.5-8B , UI-TARS-1.5-7B , OS-Atlas-Base-7B and others10 Abstract ConflictGUI 暴露 GUI 智能体的执行偏向过度服从，ConflictGuard 用条件转向提高冲突终止率。ConflictGuard 用推理时的可行性核验和条件激活转向，让 GUI 智能体在指令不可行时终止，而不是盲执行。
提出 INTENT-AS-A-TOOL，用意图工具概率跟踪并干预智能体失准
Published Aug 28
Evaluated models Gemma-4-31B-IT , Qwen3.5-27B , Qwen3-235B-A22B and others5 Abstract 用意图工具的下一动作概率跟踪推理中的失准承诺，并在其成为首选时插入反思。Zhang 等人研究推理型语言模型在职场邮件沙箱里如何走向智能体失准，并提出用动作偏好而不是事后文本标签来跟踪承诺。问题是：有害执行往往出现在推理已经形成意图之后，但 CoT 监控是事后、粗粒度、依赖外部评审的，也看不到模型倾向调用哪个动作。
提出 Agent MechSuits，对多轮 CLI Agent 做步级检测与子空间转向
Published Jun 22
Evaluated models LLaMA-3.1-8B , Qwen-2.5-7B , Gemma-2-9B Abstract 白盒步级探针加稀疏转向可压低三模型恶意动作，同时提高生成崩溃率。Agent MechSuits 是面向多轮 CLI 智能体的白盒、步级表示防御，并配有可执行轨迹基准 MAS。
Propose soft prompt defense AREA, re-anchoring attention to mitigate system prompt leakage
Published Jun 17
Evaluated models Llama-2-7B-chat-hf , Llama-3.1-8B-Instruct , Mistral-7B-Instruct-v0.3 and others8 Abstract The authors measure commercial prompt leakage, propose attention drift, and use AREA to strike a trade-off between usability and leakage resistance.The authors study system prompt leakage in real LLM applications and propose AREA, a mitigation method that does not modify weights.
提出 SciTrace，为科学发现智能体加入跨阶段安全推理与工具轨迹核验
Published Jun 6
Evaluated models Llama-3.1-70B-Instruct , Qwen2.5-72B-Instruct , DeepSeek-V3 and others4 Abstract SciTrace 把安全推理织入科学智能体各阶段，在 SciSafetyBench 上提高安全指标并保持输出质量。SciTrace 是加在科学发现智能体流水线上的安全框架，不是再在各阶段出口放一个独立过滤器。
提出推理时防御 ICON，探测注意力过聚焦并转向以纠正 Agent 间接提示注入
Published Feb 24
Evaluated models Qwen-3-8B , Llama-3.1-8B , Mistral-8B and others6 Abstract ICON 在推理时检测过聚焦并转向，以兼顾 IPI 安全与任务效用。ICON 在推理时检测 IPI 的注意力过聚焦并转向，避免以拒答中止智能体轨迹。
You have reached the end