Translation in progress Some entries still include text in the original language.
Oct 12 · Monday
All papers Found 10 papers Another 305 papers do not have category tags yet and are not included in filtered results.
“
About this collection Collection in progress We are building a large AI safety paper collection to help researchers find work related to their interests. Papers are collected automatically andfiltered only for relevance to AI safety , without judging quality, novelty or reading value. The default “Annotated first” shows papers with tags or published paper analyses first. Each group is ordered by original publication date, newest first, with undated papers last. “Newest first” uses publication dates only. This order is not a quality ranking.
One-line summaries, tags and paper analyses are prepared by AI from the papers. Language models may have systematic biases and produce hallucinations.We plan to carry out human annotation and review to reduce errors in this content.
提出 UNTAG,绕过开源权重模型的 trigger-tag 滥用检测
Published Oct 2
Evaluated models Llama2 (7B) , Llama3 (8B) , Qwen2.5 (7B) Abstract 作者用 UNTAG 评估 trigger-tag,认为其不能充当开放权重滥用检测的主要边界。UNTAG 是针对开放权重 LLM 上条件滥用检测 trigger-tag 的统一攻击评估:信号可以在解码期注入,也可以写进权重,但攻击者若能改输出或改已发布权重,检测可以失效。
提出 BAM 反馈编码,在 LLM 生成文本中实现隐蔽通信
Published Sep 22
Evaluated models Llama-3.1-8B , Qwen-3.5-9B-Base , Mistral-7B-v0.3 and others6 提出 plan injection 攻击,植入良性伪装计划以绕过思维链监视器
Published Sep 15
Evaluated models Qwen2.5-Coder-7B-Instruct , Qwen3-8B , DeepSeek-R1-0528 and others6 Abstract 论文指出模型会将外部上下文中的伪装计划改写为自身推理,使思维链监视器失效甚至反向合理化恶意行为。
提出参考嫁接,在推理阶段用激活干预诱导沙袋隐藏能力
Published Aug 30
Evaluated models Qwen2.5-1.5B , Qwen2.5-3B , Qwen2.5-14B and others15 Abstract 提出参考嫁接在推理阶段以低成本匹配微调诱导效果,揭示隐瞒表征重叠与阈值门控机制。
提出数据伪造攻击,使密码学模型认证在审计集通过但部署失效
Published Jul 24
Evaluated models SciKit-Learn decision tree , XGBoost , 226M-parameter neural network and others4 Abstract 固定审计集上的 ZKP 认证可被数据伪造绕过。这篇工作同时给出对 CMC 的数据伪造攻击,以及先承诺、后抽样的认证模板。 。
提出 GhostPrint,用低秩微调让弱模型骗过指纹审计
Published Jun 15
Evaluated models Gemma-1.1-2B , Qwen2-1.5B , Phi-3-mini Abstract GhostPrint 以 PEFT 让弱模型骗过部分指纹。GhostPrint 讨论恶意推理提供方能否只用低秩更新,让更弱的模型在用户的 black-box 指纹审计里看起来像宣传中的强模型。
提出 BENCHJACK,审计 Agent 基准中的奖励作弊缺陷
Published May 13 Abstract 论文系统揭示了智能体基准的奖励作弊隐患,提出自动化红队审计与迭代修补系统 BENCHJACK。论文系统研究了主流 AI 智能体基准评测中的奖励作弊问题,提出了首个针对基准缺陷的自动化红队审计与生成对抗式迭代修补系统 BENCHJACK。
提出 Adaptive Stealing,自适应窃取印章以擦除或伪造水印
Published Apr 13
Evaluated models OPT-2.7b , Llama3-8b Abstract AS 用逐步选印章做水印伪造与擦除,作者称其攻击效果高于固定策略的 WS。AS 是一种窃取生成式 LLM 水印的算法,用来在密钥和检测接口不可用时伪造或擦除水印。
提出 CORVUS,用 LoRA 伪装内部遥测以绕过幻觉检测器
Published Jan 19
Evaluated models Llama-2-7B-Chat , Vicuna-7B (v1.5) , Llama-3-8B-Instruct and others4 Abstract 作者称内部遥测在自适应模型侧对抗下易被操纵,CORVUS 通过轻量适配器微调降低了多种幻觉检测器的效果。
Attacks arXiv 2509.09112 · Sep 11, 2025 提出字符级扰动与遗传算法去除 LLM 水印
Published Sep 11, 2025
Evaluated models OPT-1.3B , LLaMA-3-8B Abstract 字符级扰动靠更大攻击范围移除水印。这篇工作评估推理时 LLM 水印在黑盒、有限查询下的移除难度,并比较字符级、token 级和句子级编辑。
You have reached the end