Translation in progress Some entries still include text in the original language.

Oct 13 · Tuesday

All papers

Found 27 papers

Filter6

Select any value within a category; different categories must all match. Counts include the other filters you have selected.Another 213papers have no tags yet and are not included in filtered results.

Attack technique：Dormant triggers Attack surface / entry point：Web pages and interfaces Attack surface / entry point：Memory writes Attack surface / entry point：Weights and gradients Layer：Model layer Layer：Application layer Clear all

Another 213papers do not have category tags yet and are not included in filtered results.

AttacksarXiv 2610.13928Oct 10
AI models can provably hide arbitrary capabilities
Proposes digital lock compilation, encrypting executable networks into host weights to hide arbitrary capabilities
arXiv
2610.13928
Published
Oct 10
Layer
Model layer
Setting
Models and APIs
Evaluated models
Gemma 3 270M
- AttacksPoisoning and backdoors
- TechniqueDormant triggers
AbstractThe authors use a digital lock to hide an executable capability and state that elicitation on the chemistry and parity tasks did not recover the capability.
The authors construct a class of backdoors that encrypt an executable network into the weights, used to discuss the limits of white-box elicitation audits under supply chain attacks.
Paper analysisRead analysis
AttacksarXiv 2610.07645Oct 6
SkillPoison：用成功经验投毒自进化 Agent 的技能形成
提出 SkillPoison，用局部有效的成功经验诱导自进化 Agent 形成过度泛化技能
arXiv
2610.07645
Published
Oct 6
Layer
Application layer
Setting
AI Agent
Evaluated models
deepseek-v4-flash, Qwen V3.8 Flash, GPT-5.5
- AttacksPoisoning and backdoors
- TechniqueDormant triggers
- ComponentMemory
AbstractSkillPoison 通过局部有效且验证成功的经验诱导技能过度泛化，在多个评测基准上实现了持久的下游攻击影响。
SkillPoison 提出了一种针对自进化智能体经验到技能形成过程的攻击范式，通过组织已验证的成功经验诱导技能过度泛化。
Paper analysisRead analysis
AttacksarXiv 2610.07510Oct 6
PersistBD: attackers can strengthen backdoors before release so that they maintain high attack success rates even after developer SFT and RL.
提出 PERSISTBD，发布前强化供应链后门使其经良性 SFT 与 RL 后仍外发凭据
arXiv
2610.07510
Published
Oct 6
Layer
Application layer
Setting
coding agent
Evaluated models
Qwen2.5-Coder-3B-Instruct, Qwen2.5-Coder-7B-Instruct, Qwen3-Coder-30B-A3B-Instruct
- AttacksPoisoning and backdoors
- TechniqueDormant triggers
- ComponentFine-tuning and open weights
Abstract总结了论文关于后门在 SFT/RL 中存活的发现、两因子机制、PERSISTBD 方法与核心数字。
本文研究第三方 LLM 智能体在开发者进行良性监督微调（SFT）和强化学习（RL）后训练时的后门持久性风险。
Paper analysisRead analysis
AttacksarXiv 2610.06049Oct 5
研究者提出仅修改 SAE 解码器的后门攻击，可在不改动语言模型的情况下植入行为
提出只改 SAE 解码器的后门，在冻结语言模型上植入代码插入
arXiv
2610.06049
Published
Oct 5
Layer
Model layer
Setting
Models and APIs
Evaluated models
Gemma 3 4B Instruct, Qwen3 1.7B, Llama 3.1 8B Instruct
- AttacksPoisoning and backdoors
- TechniqueDormant triggers
Abstract只改解码器的 SAE 可带上代码插入后门，且若干常规质量指标变化不大。
只改 SAE 解码器、冻结编码器与语言模型，即可把代码插入行为放进推理时的辅助组件。作者把这视为 SAE 供应链问题：checkpoint 一旦替换某一层激活，就参与后续计算，而不只是解释工具。
Paper analysisRead analysis
AttacksarXiv 2610.04589Oct 3
StegoMemory red team testing: agent persistent memory can be used as a cross-session covert channel
提出 StegoMemory，评测智能体持久记忆作为跨会话隐写信道
arXiv
2610.04589
Published
Oct 3
Layer
Application layer
Setting
AI Agent
Evaluated models
Llama 3.1 405B, Claude 3.5 Sonnet, GPT-4o and others13
- AttacksPoisoning and backdoors
- TechniqueEncoding and obfuscation
- ComponentMemory
Abstract研究揭示智能体持久记忆可作为隐蔽信道跨会话传输机密，写入持久化是主要防御瓶颈，呼吁建立记忆完整性防御。
Paper analysisRead analysis
AttacksarXiv 2610.04195Oct 3
MemLeak research: multi-tenant agents sharing vector memory stores have cross-user memory leakage
提出 MemLeak，评估多租户 Agent 共享向量记忆的跨用户泄露
arXiv
2610.04195
Published
Oct 3
Layer
Application layer
Setting
AI Agent
Evaluated models
Gemini 2.5 Flash, Claude Sonnet 4.5, all-MiniLM-L6-v2 and others5
- AttacksPoisoning and backdoors
- TechniqueDormant triggers
- ComponentMemory
Paper analysisRead analysis
AttacksarXiv 2609.35576Sep 29
研究提出跨 LLM 助手的记忆跳跃攻击
提出跨独立 Agent 的记忆跳跃攻击，经共享工件在助手间自传播
arXiv
2609.35576
Published
Sep 29
Layer
Application layer
Setting
AI Agent
Evaluated models
GPT-5.6 Luna, Kimi-K2.6, GPT-OSS-120B and others6
- AttacksPoisoning and backdoors
- TechniqueDormant triggers
- ComponentMemory
Abstract论文证实持久工件与内存可形成跨智能体传播链，揭示了将共享工件纳入安全防线的重要意义。
该论文系统研究并量化了通过共享持久工件在具有独立私有内存的 LLM 智能体之间发生自传播的“工件介导传播”攻击风险。
Paper analysisRead analysis
AttacksarXiv 2609.37468Sep 26
论文提出针对 Agentic RAG 的检索器后门攻击与 DOU 隐藏方法
提出检索器后门攻击操纵智能体搜索，并用 DOU 逃避检测
arXiv
2609.37468
Published
Sep 26
Layer
Application layer
Setting
AI Agent
Evaluated models
E5, Contriever-MSMARCO
- AttacksPoisoning and backdoors
- TechniqueDormant triggers
- ComponentRAG
Abstract论文展示了通过恶意检索器操纵智能体多轮搜索并利用诱饵重塑表征隐蔽后门的可行性与系统风险。
Paper analysisRead analysis
AttacksarXiv 2609.22510Sep 19
特拉维夫大学提出爆炸性提示词：条件触发的间接提示注入可绕过九款生产 Agent
提出条件触发的爆炸提示词，并设计摄入期检测器 DeFuse
arXiv
2609.22510
Published
Sep 19
Layer
Application layer
Setting
AI Agent
Evaluated models
Llama-3.1-8B-Instruct, Llama-3.1-70B-Instruct, Qwen2.5-32B-Instruct and others15
- DefensesDetection and filtering
- AttacksPrompt injection
- TechniqueDormant triggers
- ComponentGuardrails and judges
Abstract论文揭示了条件触发使提示注入绕过防御并在触发时执行工具，提出轻量检测器并在摄入期有效防范。
论文针对大语言模型智能体面临的间接提示注入威胁，研究了利用条件句式实现时间分离的爆炸提示词。
Paper analysisRead analysis
AttacksarXiv 2609.01222Sep 1
Researchers propose context privilege escalation attack, affecting 12 agent frameworks
提出针对 Agent Harness 的上下文特权提升攻击
arXiv
2609.01222
Published
Sep 1
Layer
Application layer
Setting
coding agent
Evaluated models
GPT-5.5, GPT-5.4 mini, Claude-Sonnet-4.6 and others7
- AttacksPrompt injection
- TechniqueDormant triggers
- ComponentMemory
Paper analysisRead analysis
Evaluation and benchmarksarXiv 2608.12851Aug 13
The researchers propose SkillMisevo-Bench to quantify the risk of skill mis-evolution in self-improving agents.
提出 SkillMisevo-Bench，量化自改进 Agent 的技能误演化
arXiv
2608.12851
Published
Aug 13
Layer
Application layer
Setting
coding agent
Evaluated models
Claude Code, Codex, Hermes and others4
- AttacksPoisoning and backdoors
- TechniqueDormant triggers
- ComponentMemory
Paper analysisRead analysis
AttacksarXiv 2608.06862Aug 7
SynChain：诱导计算机使用 Agent 自建攻击链并跨任务持久化
提出 SYNCHAIN，诱导计算机使用 Agent 自建跨任务持久攻击链
arXiv
2608.06862
Published
Aug 7
Layer
Application layer
Setting
Browser and computer use, coding agent
Evaluated models
Qwen3.5-9B, Llama-3.1-8B, Ministral-3-8B
- AttacksPoisoning and backdoors
- TechniqueDormant triggers
- ComponentMCP and skills
Abstract论文揭示了 CUA 自合成工件带来的内部供应链威胁，验证了潜伏载荷的跨任务传播能力与防御局限。
Paper analysisRead analysis
AttacksarXiv 2608.05563Aug 6
研究者提出 PoisonedEvolution 轨迹投毒攻击
提出 PoisonedEvolution 轨迹投毒，诱导自演化技能系统固化恶意行为
arXiv
2608.05563
Published
Aug 6
Layer
Application layer
Setting
AI Agent
Evaluated models
GPT-5.4, MiniMax-M2.5, DeepSeek-V3.2 and others6
- AttacksPoisoning and backdoors
- TechniqueDormant triggers
- ComponentMemory
Abstract论文揭示自演化技能系统的证据晋升漏洞，提出并验证轨迹投毒攻击。
这篇论文揭示了自演化技能系统在将交互经验转化为持久指令时的安全风险。
Paper analysisRead analysis
AttacksarXiv 2608.03844Aug 4
MAFIA：针对带审计 LLM Agent 的查询式记忆投毒攻击
提出 MAFIA，以探测放置与事实伪装对带审计 Agent 做查询式记忆投毒
arXiv
2608.03844
Published
Aug 4
Layer
Application layer
Setting
AI Agent
Evaluated models
gpt-5.4-mini, Gemini, ProtectAI and others8
- AttacksPoisoning and backdoors
- TechniqueDormant triggers
- ComponentMemory
Paper analysisRead analysis
AttacksarXiv 2608.01759Aug 3
EvoBreak 利用自我演化 Agent 的无害经验组合实施攻击
提出 EvoBreak，以良性任务组合诱导自进化 Agent 的持久经验并削弱安全边界
arXiv
2608.01759
Published
Aug 3
Layer
Application layer
Setting
AI Agent
Evaluated models
GPT-5-mini, Llama-3.1-8B-Instruct
- AttacksPoisoning and backdoors
- TechniqueAutomated search
- ComponentMemory
Paper analysisRead analysis
AttacksarXiv 2606.09084Jun 8
研究者提出 Context-Fractured Decomposition 攻击
提出 CFD 跨会话分解攻击，利用工件来源缺口绕过工具型 Agent 的本地检查
arXiv
2606.09084
Published
Jun 8
Layer
Application layer
Setting
AI Agent
Evaluated models
GPT-4.1, GPT-5-nano, Claude-3.5-Sonnet and others6
- AttacksJailbreaks
- TechniqueDormant triggers
- ComponentMemory
AbstractCFD 用无指令 artifact 把越狱拆到跨会话。
CFD针对工具型 LLM 智能体：利用 artifact 来源不被跟踪这一部署失败模式，把有害目标拆开后延迟组合。
Paper analysisRead analysis
AttacksarXiv 2606.04329Jun 3
研究者系统研究 LLM 智能体记忆投毒攻击并提出 MPBench 基准
系统研究 LLM 智能体记忆投毒并构建基准 MPBench
arXiv
2606.04329
Published
Jun 3
Layer
Application layer
Setting
AI Agent
Evaluated models
Meta-Llama-3.1-70B-Instruct, Deberta-v3-base, Llama-3.1-8B-Instruct and others5
- AttacksPoisoning and backdoors
- TechniqueDormant triggers
- ComponentMemory
Abstract系统研究了智能体记忆投毒风险，揭示了写入渠道漏洞，构建了 MPBench 基准并指出提示注入防御的局限。
Paper analysisRead analysis
AttacksarXiv 2605.15338May 15
Hidden in Memory: Latent Memory Poisoning of LLM Agents
提出潜伏记忆投毒，诱导 Agent 把外部文档写成持久伪造记忆
arXiv
2605.15338
Published
May 15
Layer
Application layer
Setting
AI Agent
Evaluated models
GPT-5.4, GPT-5.5, Claude Sonnet 4.6 and others12
- AttacksPoisoning and backdoors
- TechniqueDormant triggers
- ComponentMemory
Abstract持久记忆成为跨会话攻击面：通用载荷可写入伪造记忆，并在相关后续任务中影响行为。
sleeper memory poisoning 研究带持久记忆的 LLM 助手：外部文档能否让助手存下一则伪造的用户记忆，并在原文档消失后的新会话里被取回、用来改变回复或动作。
Paper analysisRead analysis
AttacksarXiv 2605.08460May 9
论文建模多智能体网络中的子智能体继承攻击面
建模并利用多智能体网络中子智能体生成时的记忆继承漏洞
arXiv
2605.08460
Published
May 9
Layer
Application layer
Setting
Multi-agent systems
Evaluated models
MiniMax M2.5, Llama-4-Maverick-17B-128E-Instruct-FP8, Qwen3.5-Plus and others5
- AttacksPoisoning and backdoors
- TechniqueDormant triggers
- ComponentMemory
Abstract形式化子智能体继承，在 OpenClaw 上演示四类编排层漏洞并提出防御。
作者对多智能体网络里的子智能体继承做形式化分析，并用开源框架上的 PoC 演示编排层如何让单点妥协继续扩散。
Paper analysisRead analysis
Evaluation and benchmarksarXiv 2605.01970May 4
Trojan Hippo Bench: A Dynamic Benchmark for Persistent Memory Attacks and Defenses on LLM Agents
构建 Trojan Hippo Bench，评测 Agent 持久记忆投毒与外泄
arXiv
2605.01970
Published
May 4
Layer
Application layer
Setting
AI Agent
Evaluated models
Gemini 3.1 Pro, GPT-5-mini, GPT-5
- AttacksPoisoning and backdoors
- TechniqueDormant triggers
- ComponentMemory
Abstract论文提出了评测智能体持久化记忆攻击与防御的 Trojan Hippo Bench，揭示了潜伏攻击威胁及内存防御的安全与效用权衡。
Paper analysisRead analysis

AI Safety Daily

Read the latest issueOne issue per day, updated as events develop

All papers

Attack type

Attack technique

Impact

System type

Attack surface / entry point

Layer

System component

AI models can provably hide arbitrary capabilities

SkillPoison：用成功经验投毒自进化 Agent 的技能形成

PersistBD: attackers can strengthen backdoors before release so that they maintain high attack success rates even after developer SFT and RL.

研究者提出仅修改 SAE 解码器的后门攻击，可在不改动语言模型的情况下植入行为

StegoMemory red team testing: agent persistent memory can be used as a cross-session covert channel

MemLeak research: multi-tenant agents sharing vector memory stores have cross-user memory leakage

研究提出跨 LLM 助手的记忆跳跃攻击

论文提出针对 Agentic RAG 的检索器后门攻击与 DOU 隐藏方法

特拉维夫大学提出爆炸性提示词：条件触发的间接提示注入可绕过九款生产 Agent

Researchers propose context privilege escalation attack, affecting 12 agent frameworks

The researchers propose SkillMisevo-Bench to quantify the risk of skill mis-evolution in self-improving agents.

SynChain：诱导计算机使用 Agent 自建攻击链并跨任务持久化

研究者提出 PoisonedEvolution 轨迹投毒攻击

MAFIA：针对带审计 LLM Agent 的查询式记忆投毒攻击

EvoBreak 利用自我演化 Agent 的无害经验组合实施攻击

研究者提出 Context-Fractured Decomposition 攻击

研究者系统研究 LLM 智能体记忆投毒攻击并提出 MPBench 基准

Hidden in Memory: Latent Memory Poisoning of LLM Agents

论文建模多智能体网络中的子智能体继承攻击面

Trojan Hippo Bench: A Dynamic Benchmark for Persistent Memory Attacks and Defenses on LLM Agents