Skip to content

Translation in progress Some entries still include text in the original language.

Oct 12 · Monday

All papers

Found 82 papers
Filter2

Attack type

Jailbreaks28Prompt injection17Poisoning and backdoors21Extraction and theft4Detection evasion7

Attack technique

Gradient and representation optimization30Automated search16Multi-turn escalation5Encoding and obfuscation15Cross-modal payloads48Dormant triggers8

Impact

Harmful content29Unauthorized actions6Data and privacy leaks5Output manipulation40

System type

Models and APIs44LLM applications22AI Agent16web agent5Embodied systems and robotics4

Attacker access

Black-box26Gray-box5White-box3

Attack surface / entry point

User input36Web pages and interfaces6Documents and messages3Retrieval corpus19Images, audio and video55

Layer

Prompt layer45Application layer35

System component

MCP and skills38Memory23RAG26Guardrails and judges55Monitors6Reasoning chains23Permissions and sandboxing12Fine-tuning and open weights29Vision59Audio13Video3Image generation22Embeddings9Multimodal95
Select any value within a category; different categories must all match. Counts include the other filters you have selected.Another 240papers have no tags yet and are not included in filtered results.
System component：RAGSystem component：VisionClear all

Another 240papers do not have category tags yet and are not included in filtered results.

  1. AttacksarXiv 2610.11932

    A Fudan team measures the citation fragility of AI search: ordinary posts can enter citations and answer text

    Measures citation fragility in AI search, demonstrating that ordinary public posts can enter citations and answers.

    arXiv
    2610.11932
    Published
    Layer
    Application layer
    Setting
    LLM applications
    Evaluated models
    Grok, Doubao, ChatGPT and others10

    AbstractThe authors claim the paper quantifies vulnerabilities in AI search caused by citation preferences and low posting thresholds; tests show public web posts can penetrate AI citations, and they call for auditing the citation supply chain.

    Paper analysisRead analysis
  4. AttacksarXiv 2610.09240

    WebMirage hijacks visual web agents' browser operations with adversarial images

    提出 WebMirage，用局部对抗图像劫持视觉网页 Agent 的浏览器操作

    arXiv
    2610.09240
    Published
    Layer
    Application layer
    Setting
    web agent
    Evaluated models
    LLaVA-v1.5-13B, LLaVA-v1.6-34B, MiniCPM-o-8B and others6
    Abstract论文提出了针对网络智能体的端到端视觉红队框架 WebMirage，揭示了从视觉定位到浏览器执行的安全脆弱性。

    WebMirage 是一个面向视觉定位网络智能体的流水线感知端到端红队攻击框架。

    Paper analysisRead analysis
  5. AttacksarXiv 2610.09027

    P-VMI：对抗图像经 KV cache 持续影响多轮对话

    提出持久视觉记忆注入，使对抗图像经缓存在触发时操控输出

    arXiv
    2610.09027
    Published
    Layer
    Infrastructure layer
    Setting
    Models and APIs
    Evaluated models
    Qwen3-8B, Qwen3-VL-8B-Instruct, Gemma-4-12B

    Abstract论文提出 P-VMI，证实对抗输入被掩蔽后仍可经 KV 缓存持久控制模型，强调了保留状态的安全风险。

    Paper analysisRead analysis
  11. AttacksarXiv 2609.35912

    MMSkillRisk：多模态技能图像中的隐藏指令可诱导 Agent 执行未授权操作

    提出 MMSkillRisk 基准，评测多模态技能图像中的隐藏指令诱导 Agent 越权操作

    arXiv
    2609.35912
    Published
    Layer
    Application layer
    Setting
    coding agent
    Evaluated models
    GPT-5.6-sol, Kimi-K2.6, Kimi-K3 and others6

    Abstract论文提出 MMSkillRisk 基准与 NCVA 攻击，揭示多模态技能中教学图像潜藏指令可引发未授权操作并与良性任务共存。

    Paper analysisRead analysis
  12. AttacksarXiv 2609.37468

    论文提出针对 Agentic RAG 的检索器后门攻击与 DOU 隐藏方法

    提出检索器后门攻击操纵智能体搜索，并用 DOU 逃避检测

    arXiv
    2609.37468
    Published
    Layer
    Application layer
    Setting
    AI Agent
    Evaluated models
    E5, Contriever-MSMARCO

    Abstract论文展示了通过恶意检索器操纵智能体多轮搜索并利用诱饵重塑表征隐蔽后门的可行性与系统风险。

    Paper analysisRead analysis
  13. AttacksarXiv 2609.14649

    CIG-MIA：利用上下文信息增益对 RAG 系统发起成员推断攻击

    提出 CIG-MIA，用上下文信息增益推断 RAG 知识库成员身份

    arXiv
    2609.14649
    Published
    Layer
    Application layer
    Setting
    LLM applications
    Attacker
    Gray-box, Black-box
    Evaluated models
    Llama-3.1-8B-Instruct, Mistral-7B-Instruct-v0.3, Llama-2-13b-chat-hf and others6
    AbstractCIG-MIA 用注入前后的答案似然差推断 RAG 库成员，灰盒可分性高于所列基线。

    CIG-MIA 是针对 RAG 外部知识库的成员推断攻击，同时覆盖灰盒和纯文本黑盒。

    Paper analysisRead analysis
  14. AttacksarXiv 2609.12448

    GraphProfiler 用个人知识图谱推断敏感属性并溯源到具体帖子

    提出 GraphProfiler，用个人知识图谱从帖子历史推断敏感属性并溯源

    arXiv
    2609.12448
    Published
    Layer
    Application layer
    Setting
    LLM applications
    AbstractGraphProfiler 用源链接个人知识图谱做属性推断，准确率接近文本基线，并把证据定位到少量源帖。

    GraphProfiler 是一个可审计的 LLM 敏感属性画像器：用源链接个人知识图谱，把推断落到具体帖子。

    Paper analysisRead analysis
  15. AttacksarXiv 2609.07048

    FreqDoor：面向视觉语言模型的频域后门攻击

    提出 FreqDoor，在频域混合振幅并对生成式 VLM 做训练时视觉后门

    arXiv
    2609.07048
    Published
    Layer
    Training and data layer
    Setting
    Models and APIs
    Evaluated models
    BLIP-2 (opt-2.7b), InstructBLIP (flan-t5-xl), LLaVA (interleave-qwen)
    AbstractFreqDoor 用频域振幅混合给三款 VLM 植入仅视觉的训练时后门。

    FreqDoor 是针对生成式 VLM 的仅视觉、训练时后门：在频域混合触发源振幅、保留干净图像相位，使触发在空间上分散。

    Paper analysisRead analysis
  16. AttacksarXiv 2609.04533

    Repeat-After-Me：针对黑盒 VLM 的自适应视觉提示注入攻击

    提出 Repeat-After-Me 自适应视觉提示注入，诱导 VLM 智能体执行指定任务

    arXiv
    2609.04533
    Published
    Layer
    Application layer
    Setting
    AI Agent
    Evaluated models
    Claude-Opus-4.7, GPT-5.5, Gemini-3.1-Pro and others6

    Abstract论文提出了针对黑盒 VLM 的前缀诱导自适应视觉提示注入，在多款模型上诱发了工具调用与隐私泄露。

    Paper analysisRead analysis
  17. AttacksarXiv 2609.02774

    CodePoisonRAG：针对检索增强代码生成的知识投毒攻击

    提出 CodePoisonRAG，对检索增强代码生成的知识库投毒以植入漏洞

    arXiv
    2609.02774
    Published
    Layer
    Application layer
    Setting
    LLM applications
    Evaluated models
    Qwen 3.5 9B, Code Llama 13B, DeepSeek-Coder-V2 16B

    AbstractCodePoisonRAG 展示了 RACG 外部知识库的新攻击面，在较低投毒率下可定向诱发指定漏洞并部分抵御防御。

    Paper analysisRead analysis
  19. AttacksarXiv 2609.01325

    VerTox：用可验证奖励引导的强化学习对神经排序模型实施语料投毒

    提出 VerTox，用可验证奖励强化学习生成误导文档并投毒检索语料

    arXiv
    2609.01325
    Published
    Layer
    Application layer
    Setting
    LLM applications
    Evaluated models
    SimLM-base, BGE-base, Cohere-embed-english-v3.0 and others8
    AbstractVerTox 以可验证奖励微调小 LLM，生成能抬高排序并腐蚀事实的投毒文档。

    VerTox 用可验证奖励把小 LLM 微调成语料投毒生成器，用来探测神经排序器在注入文档下的暴露面。

    Paper analysisRead analysis
Load more