Skip to content

Translation in progress Some entries still include text in the original language.

Oct 13 · Tuesday

All papers

Found 79 papers
Filter5

Attack type

Jailbreaks27Prompt injection25Poisoning and backdoors15Extraction and theft3Detection evasion10

Attack technique

Gradient and representation optimization53Automated search113Multi-turn escalation30Encoding and obfuscation67Role-play and persuasion34Conversation structure manipulation14Reasoning-chain manipulation15Cross-modal payloads61Defense-targeted28Dormant triggers38Selection manipulation12

Impact

Harmful content27Unauthorized actions7Data and privacy leaks6Output manipulation36Availability and reliability3

System type

Models and APIs43LLM applications11AI Agent25coding agent3web agent4Embodied systems and robotics4

Attacker access

Black-box20Gray-box3White-box16

Attack surface / entry point

User input32Web pages and interfaces6Documents and messages4Tool responses5Tool and skill descriptions11Retrieval corpus7Images, audio and video30Distribution channels9

Layer

Prompt layer46Model layer13Application layer33Training and data layer3

System component

MCP and skills10RAG6Guardrails and judges6Reasoning chains6Vision27Audio4Embeddings3Multimodal32
Select any value within a category; different categories must all match. Counts include the other filters you have selected.Another 213papers have no tags yet and are not included in filtered results.
Attack technique：Gradient and representation optimizationAttack technique：Conversation structure manipulationAttack technique：Selection manipulationLayer：Prompt layerLayer：Application layerClear all

Another 213papers do not have category tags yet and are not included in filtered results.

  1. AttacksarXiv 2610.12524

    An exploration of attacks on AI agent systems

    Retest and extend prompt injection against AI agents, and use Agent Card deception to manipulate A2A selection

    arXiv
    2610.12524
    Published
    Layer
    Application layer
    Setting
    AI Agent
    Evaluated models
    Ollama Mistral 0.9.5, llama3-8b-8192, gemini-2.0-flash-lite and others5
    AbstractSingle-agent filtering and classification can be bypassed by format or wording, and A2A card selection is also biased toward names and descriptions.

    The authors retested prompt injection on their own LangChain, AutoGen, and A2A systems, and modified the Agent Card to see if choices shifted. The abstract states the experiments mainly highlight single-agent weaknesses while extending attacks to multi-agent.

    Paper analysisRead analysis
  4. AttacksarXiv 2610.09240

    WebMirage hijacks visual web agents' browser operations with adversarial images

    提出 WebMirage，用局部对抗图像劫持视觉网页 Agent 的浏览器操作

    arXiv
    2610.09240
    Published
    Layer
    Application layer
    Setting
    web agent
    Evaluated models
    LLaVA-v1.5-13B, LLaVA-v1.6-34B, MiniCPM-o-8B and others6
    Abstract论文提出了针对网络智能体的端到端视觉红队框架 WebMirage，揭示了从视觉定位到浏览器执行的安全脆弱性。

    WebMirage 是一个面向视觉定位网络智能体的流水线感知端到端红队攻击框架。

    Paper analysisRead analysis
  8. AttacksarXiv 2610.04985

    研究揭示 Jev 作为应用决策层的安全与隐私风险

    评估应用决策层的输入注入与隐私推断风险

    arXiv
    2610.04985
    Published
    Layer
    Application layer
    Setting
    LLM applications
    Attacker
    Black-box, Gray-box
    Evaluated models
    Jev, NanoJev
    AbstractJev 的类型化决策可被输入与训练操纵，也会泄露信息，并同时支持检测与滥用。

    Jev 是 TypeSafe 的 System One 模型，把应用 state 和固定问题变成 Choice、Noul 或 Score 的类型化决策与概率。作者用官方 API 和可改训练的 NanoJev，考察它作为决策层时的操纵、泄露与双重用途。

    Paper analysisRead analysis
  10. AttacksarXiv 2609.39788

    研究：多智能体系统潜在通信链路可被训练用于提升有害顺从

    提出只训练或篡改多智能体潜在通信链路来提高有害遵从

    arXiv
    2609.39788
    Published
    Layer
    Application layer
    Setting
    Multi-agent systems
    Evaluated models
    Llama-3.2-3B-Instruct, Qwen2.5-3B-Instruct, Gemma-3-1B-IT and others7
    Abstract潜在链路本身即可改变冻结智能体系统的安全，奖励既能攻击也能修复。

    学习得到的潜在通信链路会改变由冻结、对齐智能体组成的系统是否遵从有害请求。。作者研究三种拓扑：双智能体、三级顺序协作，以及双专家加汇总。

    Paper analysisRead analysis
  11. AttacksarXiv 2609.36956

    研究者提出 Controlled Decoding Attacks，通过纯文本接口越狱黑盒 LLM

    提出 BLINDBIAS，通过纯文本续写与前缀控制越狱黑盒模型

    arXiv
    2609.36956
    Published
    Layer
    Prompt layer
    Setting
    Models and APIs
    Attacker
    Black-box
    Evaluated models
    GLM-5, Gemini-3.5-Flash, Qwen3-32B and others4
    Abstract作者认为，隐藏数值概率并不足以消除支持重复采样和前缀续写的解码攻击面。

    BLINDBIAS 是一种针对 sample-only 续写接口的 black-box 解码时越狱框架，研究没有目标数值概率时，采样能否支持逐步控制。

    Paper analysisRead analysis
  12. AttacksarXiv 2609.30383

    研究者提出技能级联攻击

    提出技能级联攻击，把有害目标拆散到多个技能里绕过单技能扫描

    arXiv
    2609.30383
    Published
    Layer
    Application layer
    Setting
    AI Agent
    Evaluated models
    GPT-5.4, GPT-5.4 Mini, Claude Opus 4.6 and others11

    Abstract论文探讨了多技能智能体系统面临的技能级联攻击风险，提出自动化红队框架与基准集，指出跨技能交互存在安全防护盲区。

    Paper analysisRead analysis
  14. AttacksarXiv 2609.27542

    Researchers use control token injection to delete gpt-oss-20b's reasoning chain and bypass chain-of-thought monitoring

    提出控制标记注入，清空工具 Agent 的思维链以绕过推理监控

    arXiv
    2609.27542
    Published
    Layer
    Application layer
    Setting
    AI Agent
    Evaluated models
    openai/gpt-oss-20b, google/gemma-4-26B-A4B-it, deepseek-ai/DeepSeek-R1-Distill-Qwen-7B and others4

    Abstract论文阐明控制标记注入可抑制 CoT 使监控失效并促成拒绝绕过，且工具执行受解析器宽容度影响。

    Paper analysisRead analysis
  16. InterpretabilityarXiv 2609.24801

    研究用 XAI 归因分析 Prompt Guard 2，同义词替换可翻转其提示注入判定

    用词级归因指导同义词替换，翻转提示注入检测并验证越狱

    arXiv
    2609.24801
    Published
    Layer
    Prompt layer
    Setting
    Models and APIs
    Evaluated models
    Prompt Guard 2 (86M), Llama 3.1 8B

    Abstract作者称检测靠分散的词法线索。

    Paper analysisRead analysis
  19. AttacksarXiv 2609.02172

    BOSS：以广度优先后缀搜索改进 GCG 越狱优化

    提出广度优先后缀搜索 BOSS，改进 GCG 越狱优化

    arXiv
    2609.02172
    Published
    Layer
    Prompt layer
    Setting
    Models and APIs
    Attacker
    White-box
    Evaluated models
    Llama-2-7B-Chat, Yi-1.5-9B-Chat, Qwen2-7B-Instruct and others8
    AbstractBOSS 把 GCG 类优化从单条深搜索改为多条短轨迹加源侧诊断。

    BOSS 是插在 GCG 类离散 suffix 优化上的搜索框架：局部梯度更新不变，变的是固定预算花在深度还是广度。

    Paper analysisRead analysis
Load more