Skip to content

Translation in progress Some entries still include text in the original language.

Oct 13 · Tuesday

All papers

Found 30 papers

Another 227papers do not have category tags yet and are not included in filtered results.

  1. AttacksarXiv 2610.12524

    An exploration of attacks on AI agent systems

    Retest and extend prompt injection against AI agents, and use Agent Card deception to manipulate A2A selection

    Published
    Setting
    AI Agent
    Evaluated models
    Ollama Mistral 0.9.5, llama3-8b-8192, gemini-2.0-flash-lite and others5
    AbstractSingle-agent filtering and classification can be bypassed by format or wording, and A2A card selection is also biased toward names and descriptions.

    The authors retested prompt injection on their own LangChain, AutoGen, and A2A systems, and modified the Agent Card to see if choices shifted. The abstract states the experiments mainly highlight single-agent weaknesses while extending attacks to multi-agent.

    Paper analysisRead analysis
  2. AttacksarXiv 2610.09240

    WebMirage hijacks visual web agents' browser operations with adversarial images

    提出 WebMirage,用局部对抗图像劫持视觉网页 Agent 的浏览器操作

    Published
    Setting
    web agent
    Evaluated models
    LLaVA-v1.5-13B, LLaVA-v1.6-34B, MiniCPM-o-8B and others6
    Abstract论文提出了针对网络智能体的端到端视觉红队框架 WebMirage,揭示了从视觉定位到浏览器执行的安全脆弱性。

    WebMirage 是一个面向视觉定位网络智能体的流水线感知端到端红队攻击框架。

    Paper analysisRead analysis
  3. AttacksarXiv 2610.09027

    P-VMI:对抗图像经 KV cache 持续影响多轮对话

    提出持久视觉记忆注入,使对抗图像经缓存在触发时操控输出

    Published
    Evaluated models
    Qwen3-8B, Qwen3-VL-8B-Instruct, Gemma-4-12B

    Abstract论文提出 P-VMI,证实对抗输入被掩蔽后仍可经 KV 缓存持久控制模型,强调了保留状态的安全风险。

    Paper analysisRead analysis
  4. MMSkillRisk:多模态技能图像中的隐藏指令可诱导 Agent 执行未授权操作

    提出 MMSkillRisk 基准,评测多模态技能图像中的隐藏指令诱导 Agent 越权操作

    Published
    Evaluated models
    GPT-5.6-sol, Kimi-K2.6, Kimi-K3 and others6

    Abstract论文提出 MMSkillRisk 基准与 NCVA 攻击,揭示多模态技能中教学图像潜藏指令可引发未授权操作并与良性任务共存。

    Paper analysisRead analysis
  5. AttacksarXiv 2609.18217

    研究:跨通道碎片化攻击可绕过 MCP 单通道防御

    提出跨通道分段攻击,利用 MCP 隐式信任外发敏感文件

    Published
    Evaluated models
    GPT-4o, GPT-4o-mini, GPT-5.4 and others15

    Abstract论文揭示了 MCP 多通道隐式信任层级,通过跨通道分段与协议级利用突破现有防御,展示了严重的凭证外发风险。

    Paper analysisRead analysis
  6. AttacksarXiv 2607.14493

    LogInject 框架披露 LLM 日志分析中的被动提示注入

    提出 LogInject 框架,评测日志分析中的被动提示注入及缓解

    Published
    Evaluated models
    GPT-4o, Claude 3.5 Sonnet, Llama-3-70B-Instruct

    Abstract论文评估了 LLM 日志分析中的上下文污染风险,提出分片拼接等攻击与三层防御,指出必须结合架构隔离与人工介入。

    Paper analysisRead analysis
  7. AttacksarXiv 2606.21732

    研究者提出 relinking 漏洞:LLM Agent 压缩边界可被拼出恶意指令

    提出 Relink 攻击,在 Agent 压缩边界将分散良性片段重组为恶意指令

    Published
    Setting
    AI Agent
    Evaluated models
    Gemma-4-31B-it, GPT-OSS-20B, Qwen3.6-27B and others15
    Abstract论文指出提示词压缩引入重链漏洞,提出 RELINK 攻击工具与 KBRA 边界审计防御,证明压缩边界应作为关键安全边界。

    本文研究了智能体基于摘要的提示词压缩所引入的新型安全漏洞——重链(Relinking),并提出了系统化的攻击构建方法与边界审计防御机制。

    Paper analysisRead analysis
  8. AttacksarXiv 2606.12716

    PaperGuard:针对多模态 AI 同行评审的攻击与防御基准

    提出 PaperGuard,用图文注入与梯度扰动抬高自动审稿分数并检测恶意指令

    Published
    Evaluated models
    Claude-sonnet-4.5, GPT-4o, GPT-4.1 and others11
    AbstractPaperGuard 测到提示注入与白盒视觉抬分,并比较分块检索防御。

    PaperGuard同时评测并检测多模态 AI 审稿中的评分操纵。

    Paper analysisRead analysis
  9. AttacksarXiv 2605.28074

    SilentRetrieval: Hijacking retrieval-augmented generation with semantically preserved adversarial data poisoning

    提出 SilentRetrieval,以语义保持对抗文档投毒劫持 RAG 检索与生成

    Published
    Evaluated models
    Llama-2-7B-Chat, Mistral-7B-Instruct-v0.2, Qwen-7B-Chat and others10
    Abstract两阶段投毒在单文档协议下兼顾检索劫持、生成操纵与近良性困惑度。

    SilentRetrieval 是针对 RAG 的两阶段语料投毒,在每查询一篇、合成目标答案的统一协议下,同时处理检索劫持、生成操纵和流畅度。

    Paper analysisRead analysis
  10. AttacksarXiv 2604.14604

    The AudioHijack framework achieves covert audio prompt injection against 13 speech large models

    提出 AudioHijack,用不可感知对抗音频对语音模型做上下文无关提示注入

    Published
    Evaluated models
    SpeechGPT, GLM-4-Voice, VITA-Audio and others15

    Abstract提出了 AudioHijack 框架,揭示了 LALM 对听觉提示注入的脆弱性与传统防御的局限。

    Paper analysisRead analysis
  11. AttacksarXiv 2604.01039

    Evaluating and hardening LLM system instructions against encoding attack extraction

    Extract system instructions with encoding and structured requests, and harden them by rewriting with CoT

    Published
    Attacker
    Black-box
    Evaluated models
    GPT-4.1-mini, GPT-3.5-turbo, Gemini-2.5-flash and others7
    AbstractEncoded requests can elicit system instructions after a direct refusal.

    This work evaluates and hardens the confidentiality of LLM system instructions under encoded extraction. The authors are concerned with: when direct extraction has been rejected, whether the model still surrenders protected content when the same request is rewritten as a formatting or encoding task.

    Paper analysisRead analysis
  12. AttacksarXiv 2603.17239

    LAAF: A Systematic Red-Teaming Method and Automated Attack Framework for LPCI Vulnerabilities in Agentic LLM Systems

    Proposes LAAF, which automatically attacks LPCI vulnerabilities in agent systems in stages

    Published
    Setting
    AI Agent
    Evaluated models
    gemini-2.0-flash-001, claude-3-haiku-20240307, meta-llama/llama-3.1-70b-instruct and others5
    AbstractLAAF does LPCI red teaming with taxonomy plus stage seeding.

    The authors state that LAAF is an automated red-teaming framework built specifically for LPCI in agentic LLMs. The issue to address is that encoded, delayed, and conditionally triggered payloads can persist in memory or RAG and re-enter across sessions, whereas Garak and PyRIT do not use the previous round's breakthrough results to seed the next stage across the six stages.

    Paper analysisRead analysis
  13. AttacksarXiv 2603.16960

    Adversarial attacks against modern vision-language models

    Conduct adversarial attacks on product images for open-source visual shopping agents and induce wrong purchases

    Published
    Setting
    web agent
    Evaluated models
    LLaVA-v1.5-7B, Qwen2.5-VL-7B
    AbstractThe authors state that LLaVA is easily induced by three attacks to buy the wrong item, while Qwen's correct purchase rate remains close to its clean condition.

    The authors compare the robustness of two open-source VLM shopping agents against image adversarial perturbations in a self-built e-commerce environment.

    Paper analysisRead analysis
  14. AttacksarXiv 2603.11132

    WebWeaver: Breaking the topology confidentiality of LLM multi-agent systems via covert context inference

    Propose WebWeaver, which compromises only a single agent and recovers the multi-agent communication topology from conversation context.

    Published
    Evaluated models
    Llama 3.1 8B, Qwen 2.5 7B, Mistral NeMo 12B and others6
    AbstractWebWeaver infers topology from context.

    WebWeaver is an inference attack against the confidentiality of LLM-MAS communication topology: it controls only one arbitrary agent and recovers the full graph from dialogue context, rather than querying agent IDs.

    Paper analysisRead analysis
  15. AttacksarXiv 2603.00131

    Thought Virus: viral misalignment induced by subliminal prompts in multi-agent systems

    Propose Thought Virus, which propagates preferences along multi-agent messages via subliminal prompts.

    Published
    Evaluated models
    Qwen2.5-7B-Instruct, Llama-3.1-8B-Instruct
    AbstractThought Virus spreads a single-point bias downstream.

    Thought Virus puts subliminal prompting into multi-agent communication, to see whether a single-point deviation spreads across the network without naming the target concept.

    Paper analysisRead analysis