Translation in progress Some entries still include text in the original language.
Oct 12 · Monday
Another 265 papers do not have category tags yet and are not included in filtered results.
“
About this collection Collection in progress We are building a large AI safety paper collection to help researchers find work related to their interests. Papers are collected automatically andfiltered only for relevance to AI safety , without judging quality, novelty or reading value. The default “Annotated first” shows papers with tags or published paper analyses first. Each group is ordered by original publication date, newest first, with undated papers last. “Newest first” uses publication dates only. This order is not a quality ranking.
One-line summaries, tags and paper analyses are prepared by AI from the papers. Language models may have systematic biases and produce hallucinations.We plan to carry out human annotation and review to reduce errors in this content.
提出 ReSA,从对齐模型行为恢复安全奖励并在解码时反转
Published Oct 6
Evaluated models Llama3.1-8B-Instruct , Gemma-7B-Instruct , Qwen2.5-7B-Instruct and others9 Abstract ReSA 用最大熵 IRL 从对齐模型行为恢复代理安全奖励,并在解码时反转以诱导有害输出。ReSA 是一种对抗攻击:从对齐模型的可观察行为恢复代理安全奖励,再在解码时把该奖励反过来用。 。
提出 LiBRA,在潜空间双向优化以规避图像水印双侧检测
Published Oct 2
Evaluated models Stable Signature , YU1 , HiDDeN and others4 Abstract LiBRA 用双向潜空间优化规避双侧水印检测,并提高相对反转基线的保真。
提出 UNTAG,绕过开源权重模型的 trigger-tag 滥用检测
Published Oct 2
Evaluated models Llama2 (7B) , Llama3 (8B) , Qwen2.5 (7B) Abstract 作者用 UNTAG 评估 trigger-tag,认为其不能充当开放权重滥用检测的主要边界。UNTAG 是针对开放权重 LLM 上条件滥用检测 trigger-tag 的统一攻击评估:信号可以在解码期注入,也可以写进权重,但攻击者若能改输出或改已发布权重,检测可以失效。
提出 PRETEXT 攻击,迭代改写技能文本绕过技能扫描器并让 Agent 执行木马
Published Sep 30
Evaluated models glm (z-ai/glm-5.1) , qwen3t (qwen/qwen3-235b-a22b-thinking-2507) , gpt-oss (openai/gpt-oss-120b) Abstract 论文提出了针对多阶段技能检测器的白盒攻击,揭示了单纯依赖大模型自适应检测的局限。PRETEXT 是一项针对基于“静态规则加语义大模型”的智能体技能安全检测框架的白盒攻击与协同进化评估研究。
提出 CORVUS,用 LoRA 伪装内部遥测以绕过幻觉检测器
Published Jan 19
Evaluated models Llama-2-7B-Chat , Vicuna-7B (v1.5) , Llama-3-8B-Instruct and others4 Abstract 作者称内部遥测在自适应模型侧对抗下易被操纵,CORVUS 通过轻量适配器微调降低了多种幻觉检测器的效果。
Attacks arXiv 2510.09023 · Oct 10, 2025 提出自适应攻击框架,击穿越狱与提示注入防御
Published Oct 10, 2025
Evaluated models Gemini-2.5 Pro , GPT-5 Mini , Llama-3.3 70B and others15 You have reached the end