Translation in progress Some entries still include text in the original language.

Oct 13 · Tuesday

All papers

Found 30 papers

Filter3

Select any value within a category; different categories must all match. Counts include the other filters you have selected.Another 227papers have no tags yet and are not included in filtered results.

Attack surface / entry point：Web pages and interfaces Attack surface / entry point：Inter-agent messages Layer：Application layer Clear all

Another 227papers do not have category tags yet and are not included in filtered results.

AttacksarXiv 2610.11932Oct 8
A Fudan team measures the citation fragility of AI search: ordinary posts can enter citations and answer text
Measures citation fragility in AI search, demonstrating that ordinary public posts can enter citations and answers.
arXiv
2610.11932
Published
Oct 8
Layer
Application layer
Setting
LLM applications
Evaluated models
Grok, Doubao, ChatGPT and others10
- AttacksPoisoning and backdoors
- ComponentRAG
AbstractThe authors claim the paper quantifies vulnerabilities in AI search caused by citation preferences and low posting thresholds; tests show public web posts can penetrate AI citations, and they call for auditing the citation supply chain.
Paper analysisRead analysis
AttacksarXiv 2610.12524Oct 8
An exploration of attacks on AI agent systems
Retest and extend prompt injection against AI agents, and use Agent Card deception to manipulate A2A selection
arXiv
2610.12524
Published
Oct 8
Layer
Application layer
Setting
AI Agent
Evaluated models
Ollama Mistral 0.9.5, llama3-8b-8192, gemini-2.0-flash-lite and others5
- AttacksPrompt injection
- TechniqueEncoding and obfuscation
- ComponentMCP and skills
AbstractSingle-agent filtering and classification can be bypassed by format or wording, and A2A card selection is also biased toward names and descriptions.
The authors retested prompt injection on their own LangChain, AutoGen, and A2A systems, and modified the Agent Card to see if choices shifted. The abstract states the experiments mainly highlight single-agent weaknesses while extending attacks to multi-agent.
Paper analysisRead analysis
AttacksarXiv 2610.09240Oct 7
WebMirage hijacks visual web agents' browser operations with adversarial images
提出 WebMirage，用局部对抗图像劫持视觉网页 Agent 的浏览器操作
arXiv
2610.09240
Published
Oct 7
Layer
Application layer
Setting
web agent
Evaluated models
LLaVA-v1.5-13B, LLaVA-v1.6-34B, MiniCPM-o-8B and others6
- AttacksPrompt injection
- TechniqueGradient and representation optimization
- ComponentVision
Abstract论文提出了针对网络智能体的端到端视觉红队框架 WebMirage，揭示了从视觉定位到浏览器执行的安全脆弱性。
WebMirage 是一个面向视觉定位网络智能体的流水线感知端到端红队攻击框架。
Paper analysisRead analysis
AttacksarXiv 2610.08951Oct 7
ASPIRE：面向 LLM Agent 的开放式提示注入红队引擎
提出 ASPIRE 行为图搜索，开放式发现 Agent 提示注入漏洞
arXiv
2610.08951
Published
Oct 7
Layer
Application layer
Setting
AI Agent
Evaluated models
Gemini-3.7-Flash, DeepSeek-V4-Flash, Gemini-2.5-flash
- AttacksPrompt injection
- TechniqueAutomated search
AbstractASPIRE 把提示注入红队从载荷优化改成行为图引导的开放式漏洞发现。
ASPIRE 是给搭建方用的智能体提示注入红队引擎，目标是开放式画出可利用的行为路径，而不是在固定任务上打磨一条载荷。
Paper analysisRead analysis
AttacksarXiv 2610.00430Oct 1
Memetic Trojans：利用社交传染在 LLM Agent 网络中传播对抗载荷
提出 memetic trojans，借助社交传染在 Agent 网络中传播对抗载荷
arXiv
2610.00430
Published
Oct 1
Layer
Application layer
Setting
Multi-agent systems
Evaluated models
gpt-oss-120B, deepseek-v4.1-flash, qwen-32B and others5
- AttacksPoisoning and backdoors
- ComponentMCP and skills
Abstractmemetic trojans 用内生社会传染携带载荷。
Memetic trojans 是一类网络介导攻击：对抗载荷搭在智能体本来就会转发和点赞的内容上扩散，转发者不必被攻陷，也不必执行“请继续复制”的指令。
Paper analysisRead analysis
AttacksarXiv 2610.00392Sep 30
A2A-TIBA：针对 A2A 协议 LLM 智能体的间接提示注入攻击与三层同构攻防模型
提出 A2A-TIBA，经 A2A 对等任务间接注入并植入常驻回调
arXiv
2610.00392
Published
Sep 30
Layer
Application layer
Setting
Multi-agent systems
Evaluated models
MiniMax-M3, deepseek-v4-pro, glm-5.3 and others8
- AttacksPrompt injection
- TechniqueMulti-turn escalation
- ComponentMCP and skills
AbstractA2A-TIBA 一次植入后绕过智能体，GDA 用四类结果定位防线，ELA-ITL 把信封标注列为第三层。
A2A-TIBA 把间接提示注入和绕过放进 A2A：gray-box 攻击者已能投递任务，诱导目标部署常驻回调程序后，下令和外传不再经过智能体。
Paper analysisRead analysis
AttacksarXiv 2609.33628Sep 27
用课程强化学习对前沿模型做提示注入红队测试
用跨目标课程强化学习训练提示注入红队，攻破前沿智能体
arXiv
2609.33628
Published
Sep 27
Layer
Application layer
Setting
AI Agent
Evaluated models
GPT-4o-mini, GPT-5-nano, GPT-5.6-Luna and others12
- AttacksPrompt injection
- TechniqueAutomated search
Abstract提出跨目标模型课程强化学习，攻破前沿模型冷启动瓶颈并实现跨模型迁移。
该研究针对强化学习自动化提示注入红队在攻击前沿大模型时的冷启动问题，提出了一种基于目标模型鲁棒性递进的课程强化学习方法。
Paper analysisRead analysis
AttacksarXiv 2609.24994Sep 22
BAM 反馈编码实现推理时隐蔽的智能体通信
提出 BAM 反馈编码，在 LLM 生成文本中实现隐蔽通信
arXiv
2609.24994
Published
Sep 22
Layer
Application layer
Setting
AI Agent
Evaluated models
Llama-3.1-8B, Qwen-3.5-9B-Base, Mistral-7B-v0.3 and others6
- TechniqueEncoding and obfuscation
Paper analysisRead analysis
AttacksarXiv 2609.22510Sep 19
特拉维夫大学提出爆炸性提示词：条件触发的间接提示注入可绕过九款生产 Agent
提出条件触发的爆炸提示词，并设计摄入期检测器 DeFuse
arXiv
2609.22510
Published
Sep 19
Layer
Application layer
Setting
AI Agent
Evaluated models
Llama-3.1-8B-Instruct, Llama-3.1-70B-Instruct, Qwen2.5-32B-Instruct and others15
- DefensesDetection and filtering
- AttacksPrompt injection
- TechniqueDormant triggers
- ComponentGuardrails and judges
Abstract论文揭示了条件触发使提示注入绕过防御并在触发时执行工具，提出轻量检测器并在摄入期有效防范。
论文针对大语言模型智能体面临的间接提示注入威胁，研究了利用条件句式实现时间分离的爆炸提示词。
Paper analysisRead analysis
AttacksarXiv 2608.23858Aug 25
Researchers conduct a systematic security analysis of Google AP2 v0.2, identifying 48 threats
系统分析智能体支付协议的前置上下文操纵与授权威胁
arXiv
2608.23858
Published
Aug 25
Layer
Application layer
Setting
AI Agent
- AttacksPrompt injection
- ComponentMCP and skills
Paper analysisRead analysis
AttacksarXiv 2608.05108Aug 6
PIMiner：无需再训练即可跨模型迁移的提示注入红队智能体系统
提出 PIMiner，用可复用策略库自动搜索并迁移针对智能体的提示注入
arXiv
2608.05108
Published
Aug 6
Layer
Application layer
Setting
AI Agent
Evaluated models
Gemini-2.5-Pro, DeepSeek-V4-Pro, GPT-4o-mini and others10
- AttacksPrompt injection
- TechniqueAutomated search
Paper analysisRead analysis
AttacksarXiv 2608.04741Aug 5
LoginTrap：针对 LLM Web Agent 的任务无关钓鱼式间接提示注入攻击
提出 LoginTrap，以网页弹窗诱导 Web Agent 提交敏感信息
arXiv
2608.04741
Published
Aug 5
Layer
Application layer
Setting
web agent
Evaluated models
GPT-4o, Gemini 3 Flash, Claude Sonnet 4 and others7
- AttacksPrompt injection
- TechniqueAutomated search
Abstract揭示网络智能体在黑盒网页下的登录诱导风险，利用模糊测试生成话术并跨骨干和架构验证了隐私泄露威胁。
Paper analysisRead analysis
AttacksarXiv 2608.04565Aug 5
Researchers propose Breadcrumbing long-range attack that can hijack the evidence chain of DeepResearch-style search agents
提出权威链劫持与轨迹引导策略演化，劫持搜索 Agent 的证据链
arXiv
2608.04565
Published
Aug 5
Layer
Application layer
Setting
web agent
Evaluated models
Qwen3.5-9B, Gemma4-31B, DeepResearch and others7
- AttacksPrompt injection
- TechniqueAutomated search
- ComponentRAG
Abstract论文揭示了多步搜索智能体在受限中间人操纵下的脆弱性，提出 ACH 策略与 TGSE 演化方法并完成系统验证。
Paper analysisRead analysis
AttacksarXiv 2608.00718Aug 1
研究揭示多智能体 LLM 流水线的结构性漏洞
提出多智能体流水线的边界攻击，使对抗内容作为可信输入跨层传播
arXiv
2608.00718
Published
Aug 1
Layer
Application layer
Setting
Multi-agent systems
Evaluated models
GPT-5-mini, Claude Sonnet 4.5, Kimi K2.5
- AttacksPrompt injection
Abstract缺边界校验使对抗内容跨智能体传播，作者称这是架构属性而非模型能力。
作者把多智能体 LLM 流水线的对抗问题定义为缺少边界校验，并用生产轨迹和受控实验检查脆弱性来自架构还是骨干模型。中间输出未经验证就传给下游。作者认为，一旦某级接受对抗内容，后续智能体会把它当作可信输入。
Paper analysisRead analysis
AttacksarXiv 2607.10712Jul 12
研究提出间接数据投毒攻击，可操纵 Claude、Codex 与 Gemini 的科研结论
提出间接数据投毒攻击，操纵科研智能体得出虚假结论
arXiv
2607.10712
Published
Jul 12
Layer
Application layer
Setting
science agent
Evaluated models
Claude Code with Claude Opus 4.7, Codex with GPT-5.5, Gemini CLI with Gemini 3.1 Pro
- DefensesInstruction–data separation
- AttacksPoisoning and backdoors
Paper analysisRead analysis
AttacksarXiv 2606.14517Jun 12
Researchers disclose a reasoning-amplified denial-of-service attack against LLM agent guardrails
提出针对 Agent 护栏的推理扩展拒绝服务攻击
arXiv
2606.14517
Published
Jun 12
Layer
Application layer
Setting
AI Agent
Attacker
Black-box
Evaluated models
TS-Guard-8B, Qwen3.5-9B, DeepSeek-V3.2 and others11
- AttacksDenial of service
- TechniqueReasoning-chain manipulation
- ComponentGuardrails and judges
Paper analysisRead analysis
AttacksarXiv 2606.12918Jun 11
MAStrike：用 Shapley 值引导多智能体系统协同红队攻击
提出 MAStrike，用 Shapley 选联盟对多智能体做共谋红队
arXiv
2606.12918
Published
Jun 11
Layer
Application layer
Setting
Multi-agent systems
Evaluated models
Claude Opus 4.7, GPT-5.5, Gemini 3.1 Pro
- AttacksPrompt injection
- TechniqueAutomated search
Paper analysisRead analysis
AttacksarXiv 2606.04329Jun 3
研究者系统研究 LLM 智能体记忆投毒攻击并提出 MPBench 基准
系统研究 LLM 智能体记忆投毒并构建基准 MPBench
arXiv
2606.04329
Published
Jun 3
Layer
Application layer
Setting
AI Agent
Evaluated models
Meta-Llama-3.1-70B-Instruct, Deberta-v3-base, Llama-3.1-8B-Instruct and others5
- AttacksPoisoning and backdoors
- TechniqueDormant triggers
- ComponentMemory
Abstract系统研究了智能体记忆投毒风险，揭示了写入渠道漏洞，构建了 MPBench 基准并指出提示注入防御的局限。
Paper analysisRead analysis
AttacksarXiv 2605.24421May 23
研究者提出日志型提示注入攻击，可抑制 SOC 中 LLM 分析助手的恶意日志识别
提出日志基底提示注入，操纵 SOC 分析员的分类、摘要与处置建议
arXiv
2605.24421
Published
May 23
Layer
Application layer
Setting
LLM applications
Evaluated models
gpt-4o-mini
- AttacksPrompt injection
- TechniqueConversation structure manipulation
Abstract在 gpt-4o-mini 上，人格劫持与上下文操纵可改写 SOC 分析输出，直接覆盖在分类上无效。
Paper analysisRead analysis
AttacksarXiv 2605.15338May 15
Hidden in Memory: Latent Memory Poisoning of LLM Agents
提出潜伏记忆投毒，诱导 Agent 把外部文档写成持久伪造记忆
arXiv
2605.15338
Published
May 15
Layer
Application layer
Setting
AI Agent
Evaluated models
GPT-5.4, GPT-5.5, Claude Sonnet 4.6 and others12
- AttacksPoisoning and backdoors
- TechniqueDormant triggers
- ComponentMemory
Abstract持久记忆成为跨会话攻击面：通用载荷可写入伪造记忆，并在相关后续任务中影响行为。
sleeper memory poisoning 研究带持久记忆的 LLM 助手：外部文档能否让助手存下一则伪造的用户记忆，并在原文档消失后的新会话里被取回、用来改变回复或动作。
Paper analysisRead analysis

AI Safety Daily

Read the latest issueOne issue per day, updated as events develop

All papers

Attack type

Attack technique

Impact

System type

Attack surface / entry point

Layer

System component

A Fudan team measures the citation fragility of AI search: ordinary posts can enter citations and answer text

An exploration of attacks on AI agent systems

WebMirage hijacks visual web agents' browser operations with adversarial images

ASPIRE：面向 LLM Agent 的开放式提示注入红队引擎

Memetic Trojans：利用社交传染在 LLM Agent 网络中传播对抗载荷

A2A-TIBA：针对 A2A 协议 LLM 智能体的间接提示注入攻击与三层同构攻防模型

用课程强化学习对前沿模型做提示注入红队测试

BAM 反馈编码实现推理时隐蔽的智能体通信

特拉维夫大学提出爆炸性提示词：条件触发的间接提示注入可绕过九款生产 Agent

Researchers conduct a systematic security analysis of Google AP2 v0.2, identifying 48 threats

PIMiner：无需再训练即可跨模型迁移的提示注入红队智能体系统

LoginTrap：针对 LLM Web Agent 的任务无关钓鱼式间接提示注入攻击

Researchers propose Breadcrumbing long-range attack that can hijack the evidence chain of DeepResearch-style search agents

研究揭示多智能体 LLM 流水线的结构性漏洞

研究提出间接数据投毒攻击，可操纵 Claude、Codex 与 Gemini 的科研结论

Researchers disclose a reasoning-amplified denial-of-service attack against LLM agent guardrails

MAStrike：用 Shapley 值引导多智能体系统协同红队攻击

研究者系统研究 LLM 智能体记忆投毒攻击并提出 MPBench 基准

研究者提出日志型提示注入攻击，可抑制 SOC 中 LLM 分析助手的恶意日志识别

Hidden in Memory: Latent Memory Poisoning of LLM Agents