Translation in progress Some entries still include text in the original language.
Oct 12 · Monday
All papers Found 12 papers Another 254 papers do not have category tags yet and are not included in filtered results.
“
About this collection Collection in progress We are building a large AI safety paper collection to help researchers find work related to their interests. Papers are collected automatically andfiltered only for relevance to AI safety , without judging quality, novelty or reading value. The default “Annotated first” shows papers with tags or published paper analyses first. Each group is ordered by original publication date, newest first, with undated papers last. “Newest first” uses publication dates only. This order is not a quality ranking.
One-line summaries, tags and paper analyses are prepared by AI from the papers. Language models may have systematic biases and produce hallucinations.We plan to carry out human annotation and review to reduce errors in this content.
Uses premise permutation and hidden-layer tracing to audit whether legal chain-of-thought truly relies on the cited legal provisions.
Published Oct 9
Evaluated models Qwen3-8B , Qwen3-14B , Llama-3.1-8B and others7 Abstract Using counterfactual substitution of authorities and internal commitment tracing, the authors find that legal CoT rulings depend on authorities only to a limited extent and are vulnerable to prompt injection manipulation.This study conducts an empirical audit of the causal truthfulness of legal citations in chain-of-thought reasoning of large language models in the legal domain.
提出 Tracekit，审计编码 Agent 的意图、推理与动作并检测账本篡改
Published Sep 29
Evaluated models Claude Code (claude -p, version 2.1) , 独立评审（同一 CLI，无工具） Abstract Tracekit 把意图、自述和动作写入可锚定的哈希链。Tracekit 是无第三方依赖的编码智能体审计层：把人类请求、模型自述和已执行动作并排写入可外部锚定的哈希链，执行前用正则门，事后用规则和独立模型互查。
分析量化、剪枝与 KV 缓存压缩对推理模型越狱鲁棒性的影响
Published Sep 20
Evaluated models QwQ-32B , DeepSeek-R1-Distill-Qwen-32B , DeepSeek-R1-Distill-Llama-8B Abstract 效率压缩常使 LRM 越狱 HR 下降，作者将其归因于推理退化而非对齐增强。作者分析量化、剪枝和 KV 缓存压缩如何同时改变 LRM 的显存、推理和越狱脆弱性。 。
提出 ARIA，在冻结权重上用 SAE 做推理时遗忘门控
Published Sep 15
Evaluated models DeepSeek-R1-Distill-Qwen-1.5B , Gemma-3-1B-it 系统梳理智能体执行链路中的越狱攻击与防御并比较推理时防御
Published Sep 11
Evaluated models Qwen3.5-4B , Llama-3.1-8B-Instruct Abstract SoK 将越狱重放到智能体流水线，并用两种模型检验回复层防御的边际与代价。Mia 等人把越狱安全从单轮回复扩展到智能体的规划、记忆、工具和智能体间通信，并问既有结论在更强原生对齐下是否还成立。
揭示推理加深引发的对齐坍塌，用 Reasoning Trap 放大越狱
Published Sep 8
Evaluated models Qwen3-8B , Qwen3-14B , Llama2-7B and others8 Abstract 更深推理提升题目准确率，同时提高扰动下的相对损失。作者研究扩展推理是否以对齐稳健性为代价，提出 ALR、RT 与 RRA。 。
提出针对 Agent 护栏的推理扩展拒绝服务攻击
Published Jun 12
Evaluated models TS-Guard-8B , Qwen3.5-9B , DeepSeek-V3.2 and others11 提出 Staged Decoding 与指令跟随训练，减少推理轨迹隐私泄露
Published Feb 28
Evaluated models Qwen 3 1.7B , Qwen 3 4B , Qwen 3 8B and others6 Abstract 用一般指令跟随训练加分段解码，可降低轨迹隐私泄露，但数学效用下降。本文把大推理模型的隐私问题做成轨迹可控性：隐私指令是指令，轨迹不跟随就会把敏感上下文写进可被提示注入导出的文本。
提出推理时防御 SafeThink，监视思维链并在低于阈值时注入转向前缀
Published Feb 12
Evaluated models R1-Onevision-7B , OpenVLThinker-7B , VLAA-Thinker-7B and others6 提出推理时框架 STaR，抑制大推理模型推理轨迹中的敏感内容
Published Jan 14
Evaluated models DeepSeekR1-Distill-Llama-8B Abstract STaR 以推理时轨迹调控做 LRM unlearning，作者称在 R-TOFU 上遗忘与隐私指标更好。STaR 在推理阶段约束大推理模型的整段 CoT，使指定 forget set 中的敏感内容不出现在中间步骤或最终答案里，且不更新参数。问题来自 LRM 会把敏感知识写进多步推理，而答案级遗忘在 ZeroThink、LessThink 等解码下仍可能泄漏。STaR 先判断查询是否相关并检索遗忘片段，再加安全前缀。
提出多轮在线骚扰 Agent 基准，评测记忆、规划与微调越狱
Published Oct 16, 2025
Evaluated models LLaMA-3.1-8B-Instruct , Qwen3-30B-A3B-Instruct , DeepSeekMoE-16B and others4 Attacks arXiv 2406.12814 · Jun 19, 2024 提出 ARE 框架与图像文本攻击，评测多模态网页 Agent 的对抗鲁棒性
Published Jun 19, 2024
Evaluated models GPT-4o , GPT-4V , Claude-3-Opus and others4 Abstract 系统评估多模态网页智能体的脆弱性，指出推理时计算组件被攻破会加剧系统风险。
You have reached the end