Translation in progress Some entries still include text in the original language.
Oct 12 · Monday
Another 305 papers do not have category tags yet and are not included in filtered results.
“
About this collection Collection in progress We are building a large AI safety paper collection to help researchers find work related to their interests. Papers are collected automatically andfiltered only for relevance to AI safety , without judging quality, novelty or reading value. The default “Annotated first” shows papers with tags or published paper analyses first. Each group is ordered by original publication date, newest first, with undated papers last. “Newest first” uses publication dates only. This order is not a quality ranking.
One-line summaries, tags and paper analyses are prepared by AI from the papers. Language models may have systematic biases and produce hallucinations.We plan to carry out human annotation and review to reduce errors in this content.
提出 PatchBench-Local 协议,评测激活补丁修复越狱的局部附带损伤
Published Oct 7
Evaluated models Qwen2.5-3B-Instruct , Qwen2.5-14B-Instruct , gemma-3-4b-it and others8 Abstract 论文提出 PatchBench 与局部评估协议,揭示了激活补丁在全局能力无损下仍存局部良性退化。
提出 OmniConfess,冻结候选并按通道重打分以缓解全模态幻觉
Published Oct 2
Evaluated models Qwen2.5-Omni-7B , Qwen3-Omni-30B-A3B , Nemotron-3-Nano-Omni-30B 提出 ConflictGuard,引导 GUI Agent 在冲突指令下终止执行
Published Sep 3
Evaluated models UI-Venus-1.5-8B , UI-TARS-1.5-7B , OS-Atlas-Base-7B and others10 Abstract ConflictGUI 暴露 GUI 智能体的执行偏向过度服从,ConflictGuard 用条件转向提高冲突终止率。ConflictGuard 用推理时的可行性核验和条件激活转向,让 GUI 智能体在指令不可行时终止,而不是盲执行。
提出 REINS,在 SAE 空间抑制有害延续并增强拒答
Published Aug 28
Evaluated models Qwen3.5-4B-Base , Qwen3.5-2B-Base , Gemma-3-1B-IT Abstract REINS 分角色抑制有害延续并增强拒答。REINS 是一种推理时 SAE 安全转向方法,并配有用于上下文伪装的基准 GUISE 。
提出 Agent MechSuits,对多轮 CLI Agent 做步级检测与子空间转向
Published Jun 22
Evaluated models LLaMA-3.1-8B , Qwen-2.5-7B , Gemma-2-9B Abstract 白盒步级探针加稀疏转向可压低三模型恶意动作,同时提高生成崩溃率。Agent MechSuits 是面向多轮 CLI 智能体的白盒、步级表示防御,并配有可执行轨迹基准 MAS。
提出软提示防御 AREA,重锚定注意力以缓解系统提示泄露
Published Jun 17
Evaluated models Llama-2-7B-chat-hf , Llama-3.1-8B-Instruct , Mistral-7B-Instruct-v0.3 and others8 Abstract 作者测量商用提示词泄漏,提出 attention drift,并用 AREA 在可用性与抗泄漏间取折中。作者研究真实 LLM 应用中的 system prompt 泄漏 ,并给出不改权重的缓解方法 AREA。
You have reached the end