Select any value within a category; different categories must all match. Counts include the other filters you have selected.Another 215papers have no tags yet and are not included in filtered results.

Attack technique：Role-play and persuasion Attack technique：Conversation structure manipulation Layer：Application layer Layer：Training and data layer Clear all

Another 215papers do not have category tags yet and are not included in filtered results.

AttacksarXiv 2610.12644Oct 9
Cancerous backdoor attack: progressive activation via invisible tokens and a stage controller.
Proposes the Cancerous backdoor, which progressively corrupts reasoning using invisible stage tokens.
arXiv
2610.12644
Published
Oct 9
Layer
Training and data layer
Setting
Models and APIs
Evaluated models
Llama-3.1-8B-Instruct, Qwen2.5-7B-Instruct, Mistral-7B-Instruct-v0.3
- AttacksPoisoning and backdoors
- TechniqueDormant triggers
- ComponentReasoning chains
AbstractHidden tokens plus a stage controller make the backdoor progressively corrupt reasoning upon triggering, and the authors believe that looking only at the answer will miss it.
Cancerous Backdoor Attack changes LLM backdoors from one-time activation to multi-stage reasoning corruption that accumulates progressively with triggers.
Paper analysisRead analysis
AttacksarXiv 2610.04985Oct 4
研究揭示 Jev 作为应用决策层的安全与隐私风险
评估应用决策层的输入注入与隐私推断风险
arXiv
2610.04985
Published
Oct 4
Layer
Application layer
Setting
LLM applications
Attacker
Black-box, Gray-box
Evaluated models
Jev, NanoJev
- AttacksPrompt injection
- TechniqueRole-play and persuasion
AbstractJev 的类型化决策可被输入与训练操纵，也会泄露信息，并同时支持检测与滥用。
Jev 是 TypeSafe 的 System One 模型，把应用 state 和固定问题变成 Choice、Noul 或 Score 的类型化决策与概率。作者用官方 API 和可改训练的 NanoJev，考察它作为决策层时的操纵、泄露与双重用途。
Paper analysisRead analysis
AttacksarXiv 2609.27542Sep 23
Researchers use control token injection to delete gpt-oss-20b's reasoning chain and bypass chain-of-thought monitoring
提出控制标记注入，清空工具 Agent 的思维链以绕过推理监控
arXiv
2609.27542
Published
Sep 23
Layer
Application layer
Setting
AI Agent
Evaluated models
openai/gpt-oss-20b, google/gemma-4-26B-A4B-it, deepseek-ai/DeepSeek-R1-Distill-Qwen-7B and others4
- AttacksPrompt injection
- TechniqueConversation structure manipulation
- ComponentReasoning chains
Abstract论文阐明控制标记注入可抑制 CoT 使监控失效并促成拒绝绕过，且工具执行受解析器宽容度影响。
Paper analysisRead analysis
AttacksarXiv 2609.19722Sep 17
ALIBI：向二进制注入虚假安全叙事可让 LLM 恶意软件分析器误判
提出 ALIBI，向恶意二进制注入不执行掩护叙事使分析器误判为良性
arXiv
2609.19722
Published
Sep 17
Layer
Application layer
Setting
LLM applications
Attacker
Black-box
Evaluated models
Gemini 2.5 Pro, GPT-5.5 Pro, Claude Opus 4.7
- AttacksDetection evasion
- TechniqueRole-play and persuasion
AbstractALIBI 用二进制内的掩护叙事重释可疑静态证据，Gemini 上翻转多，另两模型主要为降级。
ALIBI 是针对 LLM 恶意软件分诊的语义掩护叙事攻击：不覆盖系统指令，而把仍可见的可疑静态证据重释成良性安全产品的预期行为。
Paper analysisRead analysis
AttacksarXiv 2607.14493Jul 16
LogInject 框架披露 LLM 日志分析中的被动提示注入
提出 LogInject 框架，评测日志分析中的被动提示注入及缓解
arXiv
2607.14493
Published
Jul 16
Layer
Application layer
Setting
LLM applications
Evaluated models
GPT-4o, Claude 3.5 Sonnet, Llama-3-70B-Instruct
- AttacksPrompt injection
- TechniqueEncoding and obfuscation
- ComponentGuardrails and judges
Abstract论文评估了 LLM 日志分析中的上下文污染风险，提出分片拼接等攻击与三层防御，指出必须结合架构隔离与人工介入。
Paper analysisRead analysis
AttacksarXiv 2605.24421May 23
研究者提出日志型提示注入攻击，可抑制 SOC 中 LLM 分析助手的恶意日志识别
提出日志基底提示注入，操纵 SOC 分析员的分类、摘要与处置建议
arXiv
2605.24421
Published
May 23
Layer
Application layer
Setting
LLM applications
Evaluated models
gpt-4o-mini
- AttacksPrompt injection
- TechniqueConversation structure manipulation
Abstract在 gpt-4o-mini 上，人格劫持与上下文操纵可改写 SOC 分析输出，直接覆盖在分类上无效。
Paper analysisRead analysis
AttacksarXiv 2602.07379Feb 7
Aegis: Governance, Integrity, and Security for AI Voice Agents
Proposes the Aegis red-teaming framework for multi-turn attacks on high-risk voice agents.
arXiv
2602.07379
Published
Feb 7
Layer
Application layer
Setting
AI Agent
Evaluated models
GPT-4o, GPT-4o-mini, Gemini-1.5 Pro and others7
- AttacksDenial of service
- TechniqueMulti-turn escalation
- ComponentAudio
AbstractAegis red-teams three types of voice agents: query-based access eliminates authentication and leakage successes, but behavioral attacks remain.
Aegis uses multi-turn red-teaming evaluation on ALLM voice agents already integrated into business systems. The authors call this the first systematic red-teaming framework in this setting.
Paper analysisRead analysis
AttacksarXiv 2602.05484Feb 5
Masked Mirror: Covert Prompt Injection Attacks Against LLM-Based Phishing Detection
提出隐蔽提示注入攻击 LLM 钓鱼检测器，并给出防御 InjectDefuser
arXiv
2602.05484
Published
Feb 5
Layer
Application layer
Setting
LLM applications
Evaluated models
OpenAI GPT-5, xAI Grok 4 Fast (Non-Reasoning), Meta Llama 4 Maverick and others4
- DefensesInstruction–data separation
- AttacksPrompt injection
- TechniqueEncoding and obfuscation
- ComponentGuardrails and judges
Paper analysisRead analysis
AttacksarXiv 2602.00979Feb 1
GradingAttack: Revealing Security Vulnerabilities in LLM-Based Educational Grading Agents
提出 GradingAttack，用梯度后缀与角色扮演操纵教育评分智能体判定
arXiv
2602.00979
Published
Feb 1
Layer
Application layer
Setting
LLM applications
Evaluated models
Qwen2.5-7B, Qwen2.5-7B-Instruct, Qwen2.5-14B-Instruct and others8
- AttacksDetection evasion
- TechniqueGradient and representation optimization
Paper analysisRead analysis
AttacksarXiv 2601.21360Jan 29
Compliance Paradox: Semantic-Instruction Decoupling in Automated Academic Code Evaluation
提出 AST-ASIP ，把对抗指令植入编译器忽略区域以劫持代码评分
arXiv
2601.21360
Published
Jan 29
Layer
Application layer
Setting
LLM applications
Evaluated models
DeepSeek-V3.2, Qwen3-235B, GPT-OSS-120B and others9
- AttacksPrompt injection
- TechniqueEncoding and obfuscation
- ComponentGuardrails and judges
Abstract作者称 RLHF 的服从性使评分脱离代码。
这篇工作把自动代码评分中的失败称为 Compliance Paradox：评分模型可以离开提交逻辑，转而执行嵌在可编译代码里的隐藏指令。
Paper analysisRead analysis
AttacksarXiv 2601.22169Jan 19
In Vino Veritas and Vulnerabilities：用醉酒语言诱导检验 LLM 安全
用醉酒语言诱导改编对话模型并评测越狱与隐私泄露
arXiv
2601.22169
Published
Jan 19
Layer
Training and data layer
Setting
Models and APIs
Evaluated models
LLaMA2-7B, LLaMA3-8B, Mistral-7B and others5
- AttacksJailbreaks
- TechniqueRole-play and persuasion
- ComponentFine-tuning and open weights
Abstract醉酒语言诱导在五个 LLM 上抬高越狱与部分隐私错误，作者将其视为攻击向量。
作者把醉酒语言当作攻击向量，检验把 LLM 适配成醉酒发短信的模式后，越狱和情境隐私是否变差。动机是人类醉酒时的失范与泄密，以及 LLM 模拟人设的能力。
Paper analysisRead analysis
AttacksarXiv 2512.10449Dec 11, 2025
研究：不可见文本注入可让 LLM 审稿系统把拒稿翻成接收
提出 DSAAP，以不可见文本对科学审稿 PDF 做间接提示注入
arXiv
2512.10449
Published
Dec 11, 2025
Layer
Application layer
Setting
LLM applications
Evaluated models
gpt-oss-20B, tulu3-8B, Llama 3.1-8B and others13
- AttacksPrompt injection
- TechniqueEncoding and obfuscation
Paper analysisRead analysis
AttacksarXiv 2509.25624Sep 30, 2025
STAC：看似无害的工具调用链如何攻破 LLM Agent
提出 STAC 框架，把恶意目标拆成多轮看似无害的工具调用链
arXiv
2509.25624
Published
Sep 30, 2025
Layer
Application layer
Setting
AI Agent
Attacker
Black-box
Evaluated models
GPT-4.1-2025-04-14, GPT-4.1-mini-2025-04-14, Qwen3-32B and others8
- AttacksJailbreaks
- TechniqueMulti-turn escalation
Abstract作者提出并验证了智能体在序列化工具攻击下的普遍脆弱性，指出针对累积动作序列防御的必要性。
Paper analysisRead analysis
AttacksarXiv 2509.22040Sep 26, 2025
研究：通过编码规则文件对Cursor与GitHub Copilot实施提示注入
通过规则文件提示注入劫持编码编辑器并执行未授权终端命令
arXiv
2509.22040
Published
Sep 26, 2025
Layer
Application layer
Setting
coding agent
Evaluated models
Cursor, GitHub Copilot, Claude 4 Sonnet and others4
- AttacksPrompt injection
- TechniqueRole-play and persuasion
Abstract论文提出了针对代码编辑器的提示注入评估框架 AIShellJack，实验显示攻击能诱导 AI 执行未授权终端命令。
Paper analysisRead analysis
AttacksarXiv 2509.05372Sep 4, 2025
研究：对抗性 bug 报告可诱导 LLM 自动程序修复系统生成不安全补丁
用对抗缺陷报告诱导自动程序修复系统生成不安全补丁
arXiv
2509.05372
Published
Sep 4, 2025
Layer
Application layer
Setting
coding agent
Evaluated models
claude-sonnet-4-20250514, o4-mini, GPT-4.1-mini and others8
- AttacksPrompt injection
- TechniqueRole-play and persuasion
- ComponentGuardrails and judges
Paper analysisRead analysis

You have reached the end

AI Safety Daily

Read the latest issueOne issue per day, updated as events develop