Translation in progress Some entries still include text in the original language.
Oct 12 · Monday
Another 255 papers do not have category tags yet and are not included in filtered results.
“
About this collection Collection in progress We are building a large AI safety paper collection to help researchers find work related to their interests. Papers are collected automatically andfiltered only for relevance to AI safety , without judging quality, novelty or reading value. The default “Annotated first” shows papers with tags or published paper analyses first. Each group is ordered by original publication date, newest first, with undated papers last. “Newest first” uses publication dates only. This order is not a quality ranking.
One-line summaries, tags and paper analyses are prepared by AI from the papers. Language models may have systematic biases and produce hallucinations.We plan to carry out human annotation and review to reduce errors in this content.
Uses premise permutation and hidden-layer tracing to audit whether legal chain-of-thought truly relies on the cited legal provisions.
Published Oct 9
Evaluated models Qwen3-8B , Qwen3-14B , Llama-3.1-8B and others7 Abstract Using counterfactual substitution of authorities and internal commitment tracing, the authors find that legal CoT rulings depend on authorities only to a limited extent and are vulnerable to prompt injection manipulation.This study conducts an empirical audit of the causal truthfulness of legal citations in chain-of-thought reasoning of large language models in the legal domain.
分析量化、剪枝与 KV 缓存压缩对推理模型越狱鲁棒性的影响
Published Sep 20
Evaluated models QwQ-32B , DeepSeek-R1-Distill-Qwen-32B , DeepSeek-R1-Distill-Llama-8B Abstract 效率压缩常使 LRM 越狱 HR 下降,作者将其归因于推理退化而非对齐增强。作者分析量化、剪枝和 KV 缓存压缩如何同时改变 LRM 的显存、推理和越狱脆弱性。 。
提出 ARIA,在冻结权重上用 SAE 做推理时遗忘门控
Published Sep 15
Evaluated models DeepSeek-R1-Distill-Qwen-1.5B , Gemma-3-1B-it 揭示推理加深引发的对齐坍塌,用 Reasoning Trap 放大越狱
Published Sep 8
Evaluated models Qwen3-8B , Qwen3-14B , Llama2-7B and others8 Abstract 更深推理提升题目准确率,同时提高扰动下的相对损失。作者研究扩展推理是否以对齐稳健性为代价,提出 ALR、RT 与 RRA。 。
提出 Staged Decoding 与指令跟随训练,减少推理轨迹隐私泄露
Published Feb 28
Evaluated models Qwen 3 1.7B , Qwen 3 4B , Qwen 3 8B and others6 Abstract 用一般指令跟随训练加分段解码,可降低轨迹隐私泄露,但数学效用下降。本文把大推理模型的隐私问题做成轨迹可控性:隐私指令是指令,轨迹不跟随就会把敏感上下文写进可被提示注入导出的文本。
提出推理时防御 SafeThink,监视思维链并在低于阈值时注入转向前缀
Published Feb 12
Evaluated models R1-Onevision-7B , OpenVLThinker-7B , VLAA-Thinker-7B and others6 提出推理时框架 STaR,抑制大推理模型推理轨迹中的敏感内容
Published Jan 14
Evaluated models DeepSeekR1-Distill-Llama-8B Abstract STaR 以推理时轨迹调控做 LRM unlearning,作者称在 R-TOFU 上遗忘与隐私指标更好。STaR 在推理阶段约束大推理模型的整段 CoT,使指定 forget set 中的敏感内容不出现在中间步骤或最终答案里,且不更新参数。问题来自 LRM 会把敏感知识写进多步推理,而答案级遗忘在 ZeroThink、LessThink 等解码下仍可能泄漏。STaR 先判断查询是否相关并检索遗忘片段,再加安全前缀。
You have reached the end