Translation in progress Some entries still include text in the original language.
Oct 12 · Monday
Another 321 papers do not have category tags yet and are not included in filtered results.
“
About this collection Collection in progress We are building a large AI safety paper collection to help researchers find work related to their interests. Papers are collected automatically andfiltered only for relevance to AI safety , without judging quality, novelty or reading value. The default “Annotated first” shows papers with tags or published paper analyses first. Each group is ordered by original publication date, newest first, with undated papers last. “Newest first” uses publication dates only. This order is not a quality ranking.
One-line summaries, tags and paper analyses are prepared by AI from the papers. Language models may have systematic biases and produce hallucinations.We plan to carry out human annotation and review to reduce errors in this content.
评估应用决策层的输入注入与隐私推断风险
Published Oct 4
Evaluated models Jev , NanoJev Abstract Jev 的类型化决策可被输入与训练操纵，也会泄露信息，并同时支持检测与滥用。Jev 是 TypeSafe 的 System One 模型，把应用 state 和固定问题变成 Choice、Noul 或 Score 的类型化决策与概率。作者用官方 API 和可改训练的 NanoJev，考察它作为决策层时的操纵、泄露与双重用途。
提出 ALIBI，向恶意二进制注入不执行掩护叙事使分析器误判为良性
Published Sep 17
Evaluated models Gemini 2.5 Pro , GPT-5.5 Pro , Claude Opus 4.7 Abstract ALIBI 用二进制内的掩护叙事重释可疑静态证据，Gemini 上翻转多，另两模型主要为降级。ALIBI 是针对 LLM 恶意软件分诊的语义掩护叙事攻击：不覆盖系统指令，而把仍可见的可疑静态证据重释成良性安全产品的预期行为。
提出日志基底提示注入，操纵 SOC 分析员的分类、摘要与处置建议
Published May 23
Evaluated models gpt-4o-mini Abstract 在 gpt-4o-mini 上，人格劫持与上下文操纵可改写 SOC 分析输出，直接覆盖在分类上无效。
提出 Aegis 红队框架，多轮攻击高风险语音 Agent
Published Feb 7
Evaluated models GPT-4o , GPT-4o-mini , Gemini-1.5 Pro and others7 Abstract Aegis 红队评测三类语音智能体：查询式访问消掉认证与泄密成功，行为类攻击仍在。Aegis 用多轮红队评测已接入业务系统的 ALLM 语音智能体。作者称这是该设定下的 the first systematic red-teaming framework。
提出 GradingAttack，用梯度后缀与角色扮演操纵教育评分智能体判定
Published Feb 1
Evaluated models Qwen2.5-7B , Qwen2.5-7B-Instruct , Qwen2.5-14B-Instruct and others8 Attacks arXiv 2512.10449 · Dec 11, 2025 提出 DSAAP，以不可见文本对科学审稿 PDF 做间接提示注入
Published Dec 11, 2025
Evaluated models gpt-oss-20B , tulu3-8B , Llama 3.1-8B and others13 Attacks arXiv 2509.22040 · Sep 26, 2025 通过规则文件提示注入劫持编码编辑器并执行未授权终端命令
Published Sep 26, 2025
Evaluated models Cursor , GitHub Copilot , Claude 4 Sonnet and others4 Abstract 论文提出了针对代码编辑器的提示注入评估框架 AIShellJack，实验显示攻击能诱导 AI 执行未授权终端命令。
Attacks arXiv 2509.05372 · Sep 4, 2025 用对抗缺陷报告诱导自动程序修复系统生成不安全补丁
Published Sep 4, 2025
Evaluated models claude-sonnet-4-20250514 , o4-mini , GPT-4.1-mini and others8 You have reached the end