Skip to content

Translation in progress Some entries still include text in the original language.

Oct 12 · Monday

All papers

Found 21 papers

Another 240papers do not have category tags yet and are not included in filtered results.

  1. AttacksarXiv 2610.12524

    An exploration of attacks on AI agent systems

    重测并扩展对 AI Agent 的提示注入,并用 Agent Card 欺骗操纵 A2A 选择

    Published
    Setting
    AI Agent
    Evaluated models
    Ollama Mistral 0.9.5, llama3-8b-8192, gemini-2.0-flash-lite and others5
    Abstract单智能体过滤与分类可被格式或措辞绕过,A2A 选卡还会偏向名称和描述。

    作者在自建的 LangChain、AutoGen 和 A2A 系统上重测提示注入,并改 Agent Card 看选择是否偏移。摘要称试验主要凸显单智能体弱点,同时把攻击扩到多智能体。

    Paper analysisRead analysis
  2. AttacksarXiv 2610.00392

    A2A-TIBA:针对 A2A 协议 LLM 智能体的间接提示注入攻击与三层同构攻防模型

    提出 A2A-TIBA,经 A2A 对等任务间接注入并植入常驻回调

    Published
    Evaluated models
    MiniMax-M3, deepseek-v4-pro, glm-5.3 and others8
    AbstractA2A-TIBA 一次植入后绕过智能体,GDA 用四类结果定位防线,ELA-ITL 把信封标注列为第三层。

    A2A-TIBA 把间接提示注入和绕过放进 A2A:gray-box 攻击者已能投递任务,诱导目标部署常驻回调程序后,下令和外传不再经过智能体。

    Paper analysisRead analysis
  3. MMSkillRisk:多模态技能图像中的隐藏指令可诱导 Agent 执行未授权操作

    提出 MMSkillRisk 基准,评测多模态技能图像中的隐藏指令诱导 Agent 越权操作

    Published
    Evaluated models
    GPT-5.6-sol, Kimi-K2.6, Kimi-K3 and others6

    Abstract论文提出 MMSkillRisk 基准与 NCVA 攻击,揭示多模态技能中教学图像潜藏指令可引发未授权操作并与良性任务共存。

    Paper analysisRead analysis
  4. AttacksarXiv 2609.18217

    研究:跨通道碎片化攻击可绕过 MCP 单通道防御

    提出跨通道分段攻击,利用 MCP 隐式信任外发敏感文件

    Published
    Evaluated models
    GPT-4o, GPT-4o-mini, GPT-5.4 and others15

    Abstract论文揭示了 MCP 多通道隐式信任层级,通过跨通道分段与协议级利用突破现有防御,展示了严重的凭证外发风险。

    Paper analysisRead analysis
  5. AttacksarXiv 2607.14493

    LogInject 框架披露 LLM 日志分析中的被动提示注入

    提出 LogInject 框架,评测日志分析中的被动提示注入及缓解

    Published
    Evaluated models
    GPT-4o, Claude 3.5 Sonnet, Llama-3-70B-Instruct

    Abstract论文评估了 LLM 日志分析中的上下文污染风险,提出分片拼接等攻击与三层防御,指出必须结合架构隔离与人工介入。

    Paper analysisRead analysis
  6. AttacksarXiv 2606.21732

    研究者提出 relinking 漏洞:LLM Agent 压缩边界可被拼出恶意指令

    提出 Relink 攻击,在 Agent 压缩边界将分散良性片段重组为恶意指令

    Published
    Setting
    AI Agent
    Evaluated models
    Gemma-4-31B-it, GPT-OSS-20B, Qwen3.6-27B and others15
    Abstract论文指出提示词压缩引入重链漏洞,提出 RELINK 攻击工具与 KBRA 边界审计防御,证明压缩边界应作为关键安全边界。

    本文研究了智能体基于摘要的提示词压缩所引入的新型安全漏洞——重链(Relinking),并提出了系统化的攻击构建方法与边界审计防御机制。

    Paper analysisRead analysis
  7. AttacksarXiv 2604.01039

    Evaluating and hardening LLM system instructions against encoding attack extraction

    Extract system instructions with encoding and structured requests, and harden them by rewriting with CoT

    Published
    Attacker
    Black-box
    Evaluated models
    GPT-4.1-mini, GPT-3.5-turbo, Gemini-2.5-flash and others7
    AbstractEncoded requests can elicit system instructions after a direct refusal.

    This work evaluates and hardens the confidentiality of LLM system instructions under encoded extraction. The authors are concerned with: when direct extraction has been rejected, whether the model still surrenders protected content when the same request is rewritten as a formatting or encoding task.

    Paper analysisRead analysis
  8. AttacksarXiv 2603.17239

    LAAF: A Systematic Red-Teaming Method and Automated Attack Framework for LPCI Vulnerabilities in Agentic LLM Systems

    Proposes LAAF, which automatically attacks LPCI vulnerabilities in agent systems in stages

    Published
    Setting
    AI Agent
    Evaluated models
    gemini-2.0-flash-001, claude-3-haiku-20240307, meta-llama/llama-3.1-70b-instruct and others5
    AbstractLAAF does LPCI red teaming with taxonomy plus stage seeding.

    The authors state that LAAF is an automated red-teaming framework built specifically for LPCI in agentic LLMs. The issue to address is that encoded, delayed, and conditionally triggered payloads can persist in memory or RAG and re-enter across sessions, whereas Garak and PyRIT do not use the previous round's breakthrough results to seed the next stage across the six stages.

    Paper analysisRead analysis
  9. AttacksarXiv 2603.00131

    Thought Virus:多 Agent 系统中潜意识提示引发的病毒式失准

    提出 Thought Virus,经潜意识提示使偏好沿多 Agent 消息传播

    Published
    Evaluated models
    Qwen2.5-7B-Instruct, Llama-3.1-8B-Instruct
    AbstractThought Virus 把单点偏差传到下游。

    Thought Virus 把 subliminal prompting 放进多智能体通信,看单点偏差会不会在不点名目标概念时传到全网。

    Paper analysisRead analysis
  10. AttacksarXiv 2602.18514

    招聘中的特洛伊木马:标准模型与推理模型间接提示注入的红队测试案例研究

    用简历中的不可见指令做间接提示注入,操纵招聘推荐

    Published
    Evaluated models
    Qwen 3 30B A3B Instruct 2507, Qwen 3 30B A3B Thinking 2507

    Abstract作者称推理在简单注入下会帮攻击圆谎,在不合逻辑的复杂注入下又会把欺骗漏出来。

    Paper analysisRead analysis
  11. AttacksarXiv 2602.14211

    SkillJect: Automatically generating skill-based prompt injection for skill-based agents

    提出 SkillJect,自动生成投毒 skill 诱导代码 Agent 执行隐藏脚本

    Published
    Evaluated models
    Claude-4.6-Sonnet, GPT-5-mini, GLM-4.7 and others10
    AbstractSkillJect 用双通道和闭环精炼投毒 skill。

    SkillJect 是针对可安装 agent skill 的自动化提示注入框架。作者要解决的是:公开或手工放入 skill 的恶意指令常常被拒绝或忽略,而 skill 一旦安装就会被反复当作可信指导加载。

    Paper analysisRead analysis
  12. AttacksarXiv 2602.07379

    Aegis: Governance, Integrity, and Security for AI Voice Agents

    提出 Aegis 红队框架,多轮攻击高风险语音 Agent

    Published
    Setting
    AI Agent
    Evaluated models
    GPT-4o, GPT-4o-mini, Gemini-1.5 Pro and others7
    AbstractAegis red-teams three types of voice agents: query-based access eliminates authentication and leakage successes, but behavioral attacks remain.

    Aegis uses multi-turn red-teaming evaluation on ALLM voice agents already integrated into business systems. The authors call this the first systematic red-teaming framework in this setting.

    Paper analysisRead analysis
  13. AttacksarXiv 2601.21360

    Compliance Paradox: Semantic-Instruction Decoupling in Automated Academic Code Evaluation

    提出 AST-ASIP ,把对抗指令植入编译器忽略区域以劫持代码评分

    Published
    Evaluated models
    DeepSeek-V3.2, Qwen3-235B, GPT-OSS-120B and others9
    Abstract作者称 RLHF 的服从性使评分脱离代码。

    这篇工作把自动代码评分中的失败称为 Compliance Paradox:评分模型可以离开提交逻辑,转而执行嵌在可编译代码里的隐藏指令。

    Paper analysisRead analysis
  14. AttacksarXiv 2601.01296

    Aggressive compression enables LLM weight stealing

    提出面向渗出的权重压缩,评估推理服务器权重窃取可行性

    Published
    Attacker
    White-box
    Evaluated models
    Qwen2-1.5B, Qwen2-7B, Qwen2.5-1.5B and others8
    Abstract作者用残差量化加微调压缩权重,并称法医水印便宜且微调后仍可解码。

    这篇工作把 LLM 权重渗出看成 APT:攻击者已有未加密权重,但必须把完整权重藏进推理 API 的合法输出。作者认为可压缩性是被忽略的因素,因为推理量化要求解压后仍能低开销前向,而偷权重的人可以接受事后微调。

    Paper analysisRead analysis
  15. DREAM 框架用跨环境长链攻击评测 12 个 LLM Agent

    提出 DREAM 框架,评测 Agent 的跨环境长链攻击脆弱性

    Published
    Setting
    AI Agent
    Evaluated models
    Gemini-2.5-Flash-NT, o4-mini, Gemini-2.5-Flash and others12

    AbstractDREAM 提出基于知识图谱与策略搜索的动态红队框架,分析了长链跨环境攻击对当前主流智能体的系统性威胁。

    Paper analysisRead analysis
  16. AttacksarXiv 2509.22040

    研究:通过编码规则文件对Cursor与GitHub Copilot实施提示注入

    通过规则文件提示注入劫持编码编辑器并执行未授权终端命令

    Published
    Evaluated models
    Cursor, GitHub Copilot, Claude 4 Sonnet and others4

    Abstract论文提出了针对代码编辑器的提示注入评估框架 AIShellJack,实验显示攻击能诱导 AI 执行未授权终端命令。

    Paper analysisRead analysis