Translation in progress Some entries still include text in the original language.

Oct 13 · Tuesday

All papers

Found 23 papers

Filter4

Select any value within a category; different categories must all match. Counts include the other filters you have selected.Another 201papers have no tags yet and are not included in filtered results.

Impact：Data and privacy leaks Attack surface / entry point：Web pages and interfaces Attack surface / entry point：Documents and messages Attack surface / entry point：Memory writes Clear all

Another 201papers do not have category tags yet and are not included in filtered results.

AttacksarXiv 2610.12524Oct 8
An exploration of attacks on AI agent systems
Retest and extend prompt injection against AI agents, and use Agent Card deception to manipulate A2A selection
arXiv
2610.12524
Published
Oct 8
Layer
Application layer
Setting
AI Agent
Evaluated models
Ollama Mistral 0.9.5, llama3-8b-8192, gemini-2.0-flash-lite and others5
- AttacksPrompt injection
- TechniqueEncoding and obfuscation
- ComponentMCP and skills
AbstractSingle-agent filtering and classification can be bypassed by format or wording, and A2A card selection is also biased toward names and descriptions.
The authors retested prompt injection on their own LangChain, AutoGen, and A2A systems, and modified the Agent Card to see if choices shifted. The abstract states the experiments mainly highlight single-agent weaknesses while extending attacks to multi-agent.
Paper analysisRead analysis
Evaluation and benchmarksarXiv 2610.08871Oct 6
CredLeak-Bench
提出 CredLeak-Bench，评测 Agent 面对钓鱼的凭据泄露与恢复
arXiv
2610.08871
Published
Oct 6
Layer
Application layer
Setting
web agent
Evaluated models
Claude Sonnet 5, Claude Opus 4.8, Gemini 3.6 Flash and others7
- AttacksPrompt injection
Paper analysisRead analysis
AttacksarXiv 2610.04589Oct 3
StegoMemory red team testing: agent persistent memory can be used as a cross-session covert channel
提出 StegoMemory，评测智能体持久记忆作为跨会话隐写信道
arXiv
2610.04589
Published
Oct 3
Layer
Application layer
Setting
AI Agent
Evaluated models
Llama 3.1 405B, Claude 3.5 Sonnet, GPT-4o and others13
- AttacksPoisoning and backdoors
- TechniqueEncoding and obfuscation
- ComponentMemory
Abstract研究揭示智能体持久记忆可作为隐蔽信道跨会话传输机密，写入持久化是主要防御瓶颈，呼吁建立记忆完整性防御。
Paper analysisRead analysis
AttacksarXiv 2610.04195Oct 3
MemLeak research: multi-tenant agents sharing vector memory stores have cross-user memory leakage
提出 MemLeak，评估多租户 Agent 共享向量记忆的跨用户泄露
arXiv
2610.04195
Published
Oct 3
Layer
Application layer
Setting
AI Agent
Evaluated models
Gemini 2.5 Flash, Claude Sonnet 4.5, all-MiniLM-L6-v2 and others5
- AttacksPoisoning and backdoors
- TechniqueDormant triggers
- ComponentMemory
Paper analysisRead analysis
DefensesarXiv 2610.00371Sep 30
FlowReview：以授权配对评测控制多智能体组合信息流
提出 FlowReview，用授权配对与确定性提交门控控制多智能体组合信息流
arXiv
2610.00371
Published
Sep 30
Layer
Application layer
Setting
Multi-agent systems
Evaluated models
Sonnet 4.5, Haiku 4.5, Qwen3-32B and others5
- DefensesPermissions and approval
- AttacksPrompt injection
- ComponentPermissions and sandboxing
Abstract配对标准要求拒绝禁止使用并完成授权使用，FlowReview 把三项审查接到执行。
这篇工作把多智能体安全写成一件必须同时成立的事：拦住组合信息所启用的禁止使用，并完成同一场景里任务所需的授权使用。
Paper analysisRead analysis
Evaluation and benchmarksarXiv 2609.34790Sep 28
CoSec：面向社区场景的 LLM Agent 安全基准
用 CoSec 评测社区 Agent 是否越界披露受保护信息
arXiv
2609.34790
Published
Sep 28
Layer
Application layer
Setting
AI Agent
Evaluated models
OpenClaw with Gemini 3.1 Pro, OpenClaw with Qwen 3.8 Max, OpenClaw with MiniMax M2.5 and others13
- AttacksPrompt injection
- ComponentMemory
Paper analysisRead analysis
AttacksarXiv 2609.27542Sep 23
Researchers use control token injection to delete gpt-oss-20b's reasoning chain and bypass chain-of-thought monitoring
提出控制标记注入，清空工具 Agent 的思维链以绕过推理监控
arXiv
2609.27542
Published
Sep 23
Layer
Application layer
Setting
AI Agent
Evaluated models
openai/gpt-oss-20b, google/gemma-4-26B-A4B-it, deepseek-ai/DeepSeek-R1-Distill-Qwen-7B and others4
- AttacksPrompt injection
- TechniqueConversation structure manipulation
- ComponentReasoning chains
Abstract论文阐明控制标记注入可抑制 CoT 使监控失效并促成拒绝绕过，且工具执行受解析器宽容度影响。
Paper analysisRead analysis
AttacksarXiv 2609.13889Sep 12
PMPA：针对 OpenClaw 与 Claude Code 的持久记忆投毒攻击
提出 PMPA，经外部源向 Agent 持久记忆投毒并跨会话泄露隐私
arXiv
2609.13889
Published
Sep 12
Layer
Application layer
Setting
coding agent
Evaluated models
DeepSeek-V4-Flash, DeepSeek-V4-Pro, Qwen3-Max
- AttacksPoisoning and backdoors
- TechniqueDormant triggers
- ComponentMemory
Abstract论文提出了持久记忆投毒攻击 PMPA，报告了 harness 智能体在处理外部数据时易受跨会话记忆投毒与隐私泄露的风险。
Paper analysisRead analysis
AttacksarXiv 2609.12448Sep 11
GraphProfiler 用个人知识图谱推断敏感属性并溯源到具体帖子
提出 GraphProfiler，用个人知识图谱从帖子历史推断敏感属性并溯源
arXiv
2609.12448
Published
Sep 11
Layer
Application layer
Setting
LLM applications
- AttacksMalicious use
- ComponentRAG
AbstractGraphProfiler 用源链接个人知识图谱做属性推断，准确率接近文本基线，并把证据定位到少量源帖。
GraphProfiler 是一个可审计的 LLM 敏感属性画像器：用源链接个人知识图谱，把推断落到具体帖子。
Paper analysisRead analysis
DefensesarXiv 2609.04875Sep 4
Forgetting without restart: execution-state forgetting for stateful LLM agents
Proposes execution-state forgetting, using provenance-guided selective replay to purify stateful agents
arXiv
2609.04875
Published
Sep 4
Layer
Application layer
Setting
AI Agent
Evaluated models
Llama-3.1-8B-Instruct, Qwen2.5-7B-Instruct, Mistral-7B-Instruct-v0.3
- AttacksPrompt injection
- ComponentMemory
AbstractSelective replay concatenates the clean prefix with the sanitized suffix, and main-table metrics match full reset.
This work defines forgetting in long-horizon agents as runtime counterfactual equivalence, rather than deleting a plaintext memory.
Paper analysisRead analysis
DefensesarXiv 2608.22868Aug 24
AgentFlow：面向 LLM 智能体系统的流中心策略语言与运行时防护框架
提出 AgentFlow 流策略语言与运行时框架，约束智能体跨步数据流
arXiv
2608.22868
Published
Aug 24
Layer
Application layer
Setting
AI Agent
- DefensesInstruction–data separation
- AttacksPrompt injection
- ComponentPermissions and sandboxing
Paper analysisRead analysis
AttacksarXiv 2608.05563Aug 6
研究者提出 PoisonedEvolution 轨迹投毒攻击
提出 PoisonedEvolution 轨迹投毒，诱导自演化技能系统固化恶意行为
arXiv
2608.05563
Published
Aug 6
Layer
Application layer
Setting
AI Agent
Evaluated models
GPT-5.4, MiniMax-M2.5, DeepSeek-V3.2 and others6
- AttacksPoisoning and backdoors
- TechniqueDormant triggers
- ComponentMemory
Abstract论文揭示自演化技能系统的证据晋升漏洞，提出并验证轨迹投毒攻击。
这篇论文揭示了自演化技能系统在将交互经验转化为持久指令时的安全风险。
Paper analysisRead analysis
AttacksarXiv 2608.04741Aug 5
LoginTrap：针对 LLM Web Agent 的任务无关钓鱼式间接提示注入攻击
提出 LoginTrap，以网页弹窗诱导 Web Agent 提交敏感信息
arXiv
2608.04741
Published
Aug 5
Layer
Application layer
Setting
web agent
Evaluated models
GPT-4o, Gemini 3 Flash, Claude Sonnet 4 and others7
- AttacksPrompt injection
- TechniqueAutomated search
Abstract揭示网络智能体在黑盒网页下的登录诱导风险，利用模糊测试生成话术并跨骨干和架构验证了隐私泄露威胁。
Paper analysisRead analysis
Evaluation and benchmarksarXiv 2608.00677Aug 1
OpenART 提出环境演化红队框架
构建 OpenART 竞技场，以 EMHA 演化持久环境评测智能体安全
arXiv
2608.00677
Published
Aug 1
Layer
Application layer
Setting
AI Agent
Evaluated models
GPT-5.5, Claude-Opus-4.8, GLM-5.2 and others5
- AttacksPrompt injection
- TechniqueAutomated search
Paper analysisRead analysis
AttacksarXiv 2607.26115Jul 29
OpenAI releases GPT-Red: training automated red-teaming agents through self-play
训练自博弈红队智能体 GPT-Red，规模化生成提示注入与越狱攻击
arXiv
2607.26115
Published
Jul 29
Layer
Application layer
Setting
AI Agent
Attacker
Black-box
Evaluated models
GPT-5.6, GPT-5.5, GPT-5.4 and others8
- AttacksPrompt injection
- TechniqueAutomated search
Paper analysisRead analysis
Evaluation and benchmarksarXiv 2607.14611Jul 16
论文评测 Claude Code 与 Codex 记忆文件中的提示注入风险
评测编码 Agent 记忆文件中提示注入的跨会话影响
arXiv
2607.14611
Published
Jul 16
Layer
Application layer
Setting
coding agent
Evaluated models
Claude Haiku 4.5, Claude Opus 4.7, GPT-5.2 and others4
- AttacksPoisoning and backdoors
- ComponentMemory
Abstract已植入记忆文件的载荷可以跨会话影响 Claude Code 与 Codex，攻击成功与载荷是否留下是两种不同的失败。
Bad Memory 在沙箱合成工作区里评测文件型持久记忆上的提示注入，比较载荷能否改变当前会话，以及能否在后续会话中留下或叠加。
Paper analysisRead analysis
AttacksarXiv 2606.09084Jun 8
研究者提出 Context-Fractured Decomposition 攻击
提出 CFD 跨会话分解攻击，利用工件来源缺口绕过工具型 Agent 的本地检查
arXiv
2606.09084
Published
Jun 8
Layer
Application layer
Setting
AI Agent
Evaluated models
GPT-4.1, GPT-5-nano, Claude-3.5-Sonnet and others6
- AttacksJailbreaks
- TechniqueDormant triggers
- ComponentMemory
AbstractCFD 用无指令 artifact 把越狱拆到跨会话。
CFD针对工具型 LLM 智能体：利用 artifact 来源不被跟踪这一部署失败模式，把有害目标拆开后延迟组合。
Paper analysisRead analysis
DefensesarXiv 2605.17380May 17
Uber proposes ADR enterprise-level agent detection system, deployed on 7,200 hosts for ten months
提出企业级检测系统 ADR，识别编程 Agent 的提示注入与恶意 MCP
arXiv
2605.17380
Published
May 17
Layer
Application layer
Setting
coding agent
- DefensesDetection and filtering
- AttacksPrompt injection
- ComponentMCP and skills
Abstract提出了端点因果遥测、两级在线分流与离线红队闭环的 ADR 系统，并在生产环境中验证了有效性。
Paper analysisRead analysis
AttacksarXiv 2605.05509May 7
研究者提出面向 Agent 浏览器的 Web 威胁模型，梳理 20 类攻击并在 4 个模型上复现
提出面向智能体浏览器的 Web 威胁模型并复现混淆攻击
arXiv
2605.05509
Published
May 7
Layer
Application layer
Setting
web agent
Evaluated models
GPT-5, Claude-Sonnet-4.6, Kimi-k2p5 and others8
- AttacksPrompt injection
Abstract作者提出面向智能体浏览器的 Web 威胁模型与攻击分类，测试显示传统混淆攻击可复现且能绕过现有防御。
这篇论文研究了智能体浏览器在面临传统 Web 攻击者时的安全性问题，指出当前针对提示词注入的安全假设无法抵御基于正常 Web 交互模式的混淆攻击。
Paper analysisRead analysis
Evaluation and benchmarksarXiv 2605.01970May 4
Trojan Hippo Bench: A Dynamic Benchmark for Persistent Memory Attacks and Defenses on LLM Agents
构建 Trojan Hippo Bench，评测 Agent 持久记忆投毒与外泄
arXiv
2605.01970
Published
May 4
Layer
Application layer
Setting
AI Agent
Evaluated models
Gemini 3.1 Pro, GPT-5-mini, GPT-5
- AttacksPoisoning and backdoors
- TechniqueDormant triggers
- ComponentMemory
Abstract论文提出了评测智能体持久化记忆攻击与防御的 Trojan Hippo Bench，揭示了潜伏攻击威胁及内存防御的安全与效用权衡。
Paper analysisRead analysis

AI Safety Daily

Read the latest issueOne issue per day, updated as events develop

All papers

Attack type

Attack technique

Impact

System type

Attack surface / entry point

Layer

System component

An exploration of attacks on AI agent systems

CredLeak-Bench

StegoMemory red team testing: agent persistent memory can be used as a cross-session covert channel

MemLeak research: multi-tenant agents sharing vector memory stores have cross-user memory leakage

FlowReview：以授权配对评测控制多智能体组合信息流

CoSec：面向社区场景的 LLM Agent 安全基准

Researchers use control token injection to delete gpt-oss-20b's reasoning chain and bypass chain-of-thought monitoring

PMPA：针对 OpenClaw 与 Claude Code 的持久记忆投毒攻击

GraphProfiler 用个人知识图谱推断敏感属性并溯源到具体帖子

Forgetting without restart: execution-state forgetting for stateful LLM agents

AgentFlow：面向 LLM 智能体系统的流中心策略语言与运行时防护框架

研究者提出 PoisonedEvolution 轨迹投毒攻击

LoginTrap：针对 LLM Web Agent 的任务无关钓鱼式间接提示注入攻击

OpenART 提出环境演化红队框架

OpenAI releases GPT-Red: training automated red-teaming agents through self-play

论文评测 Claude Code 与 Codex 记忆文件中的提示注入风险

研究者提出 Context-Fractured Decomposition 攻击

Uber proposes ADR enterprise-level agent detection system, deployed on 7,200 hosts for ten months

研究者提出面向 Agent 浏览器的 Web 威胁模型，梳理 20 类攻击并在 4 个模型上复现

Trojan Hippo Bench: A Dynamic Benchmark for Persistent Memory Attacks and Defenses on LLM Agents