Skip to content

Translation in progress Some entries still include text in the original language.

Oct 13 · Tuesday

All papers

Found 22 papers
Filter6

Attack type

Prompt injection15Poisoning and backdoors10

Attack technique

Gradient and representation optimization10Automated search26Encoding and obfuscation11Role-play and persuasion8Conversation structure manipulation4Cross-modal payloads4Defense-targeted8Dormant triggers23Selection manipulation8

Impact

Harmful content3Unauthorized actions7Data and privacy leaks5Output manipulation17

System type

LLM applications11AI Agent11

Attack surface / entry point

User input6Web pages and interfaces3Documents and messages5Tool responses3Tool and skill descriptions6Retrieval corpus7Distribution channels5

Layer

Prompt layer21Model layer4Application layer22

System component

MCP and skills6RAG6Vision3Embeddings3Multimodal3
Select any value within a category; different categories must all match. Counts include the other filters you have selected.Another 201papers have no tags yet and are not included in filtered results.
Attack technique：Gradient and representation optimizationAttack technique：Conversation structure manipulationAttack technique：Selection manipulationImpact：Data and privacy leaksImpact：Output manipulationLayer：Application layerClear all

Another 201papers do not have category tags yet and are not included in filtered results.

  1. AttacksarXiv 2610.12524

    An exploration of attacks on AI agent systems

    Retest and extend prompt injection against AI agents, and use Agent Card deception to manipulate A2A selection

    arXiv
    2610.12524
    Published
    Layer
    Application layer
    Setting
    AI Agent
    Evaluated models
    Ollama Mistral 0.9.5, llama3-8b-8192, gemini-2.0-flash-lite and others5
    AbstractSingle-agent filtering and classification can be bypassed by format or wording, and A2A card selection is also biased toward names and descriptions.

    The authors retested prompt injection on their own LangChain, AutoGen, and A2A systems, and modified the Agent Card to see if choices shifted. The abstract states the experiments mainly highlight single-agent weaknesses while extending attacks to multi-agent.

    Paper analysisRead analysis
  2. AttacksarXiv 2610.04985

    研究揭示 Jev 作为应用决策层的安全与隐私风险

    评估应用决策层的输入注入与隐私推断风险

    arXiv
    2610.04985
    Published
    Layer
    Application layer
    Setting
    LLM applications
    Attacker
    Black-box, Gray-box
    Evaluated models
    Jev, NanoJev
    AbstractJev 的类型化决策可被输入与训练操纵，也会泄露信息，并同时支持检测与滥用。

    Jev 是 TypeSafe 的 System One 模型，把应用 state 和固定问题变成 Choice、Noul 或 Score 的类型化决策与概率。作者用官方 API 和可改训练的 NanoJev，考察它作为决策层时的操纵、泄露与双重用途。

    Paper analysisRead analysis
  3. AttacksarXiv 2609.30383

    研究者提出技能级联攻击

    提出技能级联攻击，把有害目标拆散到多个技能里绕过单技能扫描

    arXiv
    2609.30383
    Published
    Layer
    Application layer
    Setting
    AI Agent
    Evaluated models
    GPT-5.4, GPT-5.4 Mini, Claude Opus 4.6 and others11

    Abstract论文探讨了多技能智能体系统面临的技能级联攻击风险，提出自动化红队框架与基准集，指出跨技能交互存在安全防护盲区。

    Paper analysisRead analysis
  4. AttacksarXiv 2609.27542

    Researchers use control token injection to delete gpt-oss-20b's reasoning chain and bypass chain-of-thought monitoring

    提出控制标记注入，清空工具 Agent 的思维链以绕过推理监控

    arXiv
    2609.27542
    Published
    Layer
    Application layer
    Setting
    AI Agent
    Evaluated models
    openai/gpt-oss-20b, google/gemma-4-26B-A4B-it, deepseek-ai/DeepSeek-R1-Distill-Qwen-7B and others4

    Abstract论文阐明控制标记注入可抑制 CoT 使监控失效并促成拒绝绕过，且工具执行受解析器宽容度影响。

    Paper analysisRead analysis
  8. AttacksarXiv 2608.25776

    EvoMal attack uses self-poisoning of self-evolving coding agents to achieve worm-like propagation

    提出 EVOMAL，诱导自演化编码 Agent 在创建技能时自我投毒并蠕虫传播

    arXiv
    2608.25776
    Published
    Layer
    Application layer
    Setting
    coding agent
    Evaluated models
    Devstral-Small-2, Gemma-4-31B-IT, Qwen3-Coder-Next and others7

    Abstract论文指出了自演化智能体模仿检索代码的自我毒化漏洞，提出 EVOMAL 攻击与防御，阐明了供应链新风险。

    Paper analysisRead analysis
  10. AttacksarXiv 2607.14493

    LogInject 框架披露 LLM 日志分析中的被动提示注入

    提出 LogInject 框架，评测日志分析中的被动提示注入及缓解

    arXiv
    2607.14493
    Published
    Layer
    Application layer
    Setting
    LLM applications
    Evaluated models
    GPT-4o, Claude 3.5 Sonnet, Llama-3-70B-Instruct

    Abstract论文评估了 LLM 日志分析中的上下文污染风险，提出分片拼接等攻击与三层防御，指出必须结合架构隔离与人工介入。

    Paper analysisRead analysis
  11. AttacksarXiv 2607.00422

    KidnapRAG：黑盒投毒攻击劫持 Agentic RAG 的推理链

    提出 KidnapRAG，用投毒文档黑盒劫持 Agentic RAG 的推理链

    arXiv
    2607.00422
    Published
    Layer
    Application layer
    Setting
    AI Agent
    Evaluated models
    Qwen2.5-32B-Instruct, Llama-3.3-70B-Instruct, QwQ-32B and others5
    Abstract顺序投毒可把多步推理拖向指定应答，作者称关键在持续引导而非单次注入。

    KidnapRAG 是针对 Agentic RAG 的 black-box 语料投毒：攻击者不能访问模型、提示词、检索器或私有轨迹，只能发布可能被检索的文档，并利用公开界面上的推理与搜索查询。

    Paper analysisRead analysis
  12. AttacksarXiv 2606.12716

    PaperGuard：针对多模态 AI 同行评审的攻击与防御基准

    提出 PaperGuard，用图文注入与梯度扰动抬高自动审稿分数并检测恶意指令

    arXiv
    2606.12716
    Published
    Layer
    Application layer
    Setting
    LLM applications
    Evaluated models
    Claude-sonnet-4.5, GPT-4o, GPT-4.1 and others11
    AbstractPaperGuard 测到提示注入与白盒视觉抬分，并比较分块检索防御。

    PaperGuard同时评测并检测多模态 AI 审稿中的评分操纵。

    Paper analysisRead analysis
  13. AttacksarXiv 2606.11265

    论文提出 CRCP 投毒框架，揭示 RAG 分块与重排序下的投毒失效问题

    提出 CRCP 框架，优化分块与重排下的 RAG 语料投毒

    arXiv
    2606.11265
    Published
    Layer
    Application layer
    Setting
    LLM applications
    Evaluated models
    GPT-4o, DeepSeek-R1, Qwen3-Max and others11
    AbstractCRCP 把投毒做成多阶段一致性问题。

    CRCP 研究的是带分块和重排的 RAG 语料投毒，而不是只提高文档级检索分数。

    Paper analysisRead analysis
  14. AttacksarXiv 2605.28074

    SilentRetrieval: Hijacking retrieval-augmented generation with semantically preserved adversarial data poisoning

    提出 SilentRetrieval，以语义保持对抗文档投毒劫持 RAG 检索与生成

    arXiv
    2605.28074
    Published
    Layer
    Application layer
    Setting
    LLM applications
    Evaluated models
    Llama-2-7B-Chat, Mistral-7B-Instruct-v0.2, Qwen-7B-Chat and others10
    Abstract两阶段投毒在单文档协议下兼顾检索劫持、生成操纵与近良性困惑度。

    SilentRetrieval 是针对 RAG 的两阶段语料投毒，在每查询一篇、合成目标答案的统一协议下，同时处理检索劫持、生成操纵和流畅度。

    Paper analysisRead analysis
  15. AttacksarXiv 2605.24421

    研究者提出日志型提示注入攻击，可抑制 SOC 中 LLM 分析助手的恶意日志识别

    提出日志基底提示注入，操纵 SOC 分析员的分类、摘要与处置建议

    arXiv
    2605.24421
    Published
    Layer
    Application layer
    Setting
    LLM applications
    Evaluated models
    gpt-4o-mini

    Abstract在 gpt-4o-mini 上，人格劫持与上下文操纵可改写 SOC 分析输出，直接覆盖在分类上无效。

    Paper analysisRead analysis
  18. AttacksarXiv 2603.16960

    Adversarial attacks against modern vision-language models

    Conduct adversarial attacks on product images for open-source visual shopping agents and induce wrong purchases

    arXiv
    2603.16960
    Published
    Layer
    Application layer
    Setting
    web agent
    Evaluated models
    LLaVA-v1.5-7B, Qwen2.5-VL-7B
    AbstractThe authors state that LLaVA is easily induced by three attacks to buy the wrong item, while Qwen's correct purchase rate remains close to its clean condition.

    The authors compare the robustness of two open-source VLM shopping agents against image adversarial perturbations in a self-built e-commerce environment.

    Paper analysisRead analysis
  19. AttacksarXiv 2603.11132

    WebWeaver: Breaking the topology confidentiality of LLM multi-agent systems via covert context inference

    Propose WebWeaver, which compromises only a single agent and recovers the multi-agent communication topology from conversation context.

    arXiv
    2603.11132
    Published
    Layer
    Application layer
    Setting
    Multi-agent systems
    Evaluated models
    Llama 3.1 8B, Qwen 2.5 7B, Mistral NeMo 12B and others6
    AbstractWebWeaver infers topology from context.

    WebWeaver is an inference attack against the confidentiality of LLM-MAS communication topology: it controls only one arbitrary agent and recovers the full graph from dialogue context, rather than querying agent IDs.

    Paper analysisRead analysis
Load more