Skip to content

Translation in progress Some entries still include text in the original language.

Oct 13 · Tuesday

All papers

Found 16 papers

Another 213papers do not have category tags yet and are not included in filtered results.

  1. AttacksarXiv 2610.07723

    Researchers propose answer-side backdoors: letting the model self-generate trigger words to bypass safety refusals.

    提出回答端后门,让模型自生成触发词以在干净有害请求下绕过拒答

    Published
    Evaluated models
    Llama-2-7B-chat-hf, Mistral-7B-Instruct-v0.3, Gemma-7B-it and others4

    Abstract论文提出了多轮对话中回答端自生成触发词绕过安全拒绝的后门攻击,指出输入端防护存在盲区。

    Paper analysisRead analysis
  2. 研究评估 GradSafe 在多轮对话中的越狱检测脆弱性

    评测多轮对话中 GradSafe 越狱检测的可分性与脆弱性

    Published
    Evaluated models
    Llama 3.1 8B Instruct, Qwen2.5-7B-Instruct
    AbstractCWS 显示不安全梯度在真实多轮流量中变弱,且随攻击族和模型而变。

    作者评估梯度越狱检测从单条提示词迁到多轮对话后还剩多少可分性,方法是用 Context Window Scanner 把 GradSafe 原封不动地套到用户轮窗口上。

    Paper analysisRead analysis
  3. 研究用 XAI 归因分析 Prompt Guard 2,同义词替换可翻转其提示注入判定

    用词级归因指导同义词替换,翻转提示注入检测并验证越狱

    Published
    Evaluated models
    Prompt Guard 2 (86M), Llama 3.1 8B

    Abstract作者称检测靠分散的词法线索。

    Paper analysisRead analysis
  4. AttacksarXiv 2609.22510

    特拉维夫大学提出爆炸性提示词:条件触发的间接提示注入可绕过九款生产 Agent

    提出条件触发的爆炸提示词,并设计摄入期检测器 DeFuse

    Published
    Setting
    AI Agent
    Evaluated models
    Llama-3.1-8B-Instruct, Llama-3.1-70B-Instruct, Qwen2.5-32B-Instruct and others15
    Abstract论文揭示了条件触发使提示注入绕过防御并在触发时执行工具,提出轻量检测器并在摄入期有效防范。

    论文针对大语言模型智能体面临的间接提示注入威胁,研究了利用条件句式实现时间分离的爆炸提示词。

    Paper analysisRead analysis
  5. AttacksarXiv 2606.12716

    PaperGuard:针对多模态 AI 同行评审的攻击与防御基准

    提出 PaperGuard,用图文注入与梯度扰动抬高自动审稿分数并检测恶意指令

    Published
    Evaluated models
    Claude-sonnet-4.5, GPT-4o, GPT-4.1 and others11
    AbstractPaperGuard 测到提示注入与白盒视觉抬分,并比较分块检索防御。

    PaperGuard同时评测并检测多模态 AI 审稿中的评分操纵。

    Paper analysisRead analysis
  6. AttacksarXiv 2606.09084

    研究者提出 Context-Fractured Decomposition 攻击

    提出 CFD 跨会话分解攻击,利用工件来源缺口绕过工具型 Agent 的本地检查

    Published
    Setting
    AI Agent
    Evaluated models
    GPT-4.1, GPT-5-nano, Claude-3.5-Sonnet and others6
    AbstractCFD 用无指令 artifact 把越狱拆到跨会话。

    CFD针对工具型 LLM 智能体:利用 artifact 来源不被跟踪这一部署失败模式,把有害目标拆开后延迟组合。

    Paper analysisRead analysis
  7. MultiTurnPSB

    构建 MultiTurnPSB,评测四轮医疗越狱与分类器输入防御

    Published
    Evaluated models
    GPT-4.1-mini, Claude Sonnet 4.5
    Abstract多轮攻击加剧医疗模型风险,分类器干预有效但受高误报率制约。

    MultiTurnPSB 针对患者端医疗大模型在持续交互中的安全风险,构建了包含三种攻击模态的四轮对抗评测基准。

    Paper analysisRead analysis
  8. AttacksarXiv 2605.28074

    SilentRetrieval: Hijacking retrieval-augmented generation with semantically preserved adversarial data poisoning

    提出 SilentRetrieval,以语义保持对抗文档投毒劫持 RAG 检索与生成

    Published
    Evaluated models
    Llama-2-7B-Chat, Mistral-7B-Instruct-v0.2, Qwen-7B-Chat and others10
    Abstract两阶段投毒在单文档协议下兼顾检索劫持、生成操纵与近良性困惑度。

    SilentRetrieval 是针对 RAG 的两阶段语料投毒,在每查询一篇、合成目标答案的统一协议下,同时处理检索劫持、生成操纵和流畅度。

    Paper analysisRead analysis
  9. AttacksarXiv 2604.03890

    From prompts to physical actions: structured backdoor attacks against LLM-mediated robot control systems

    Propose a structured JSON backdoor that triggers malicious actions in robot control via a poisoned LoRA

    Published
    Evaluated models
    Llama-3.1-8B-Instruct, Gemma-2-9B-IT, DeepSeek-R1-Distill-Llama-8B and others4

    Abstract推理层后门传不到执行。

    Paper analysisRead analysis
  10. ADVERSA: Measuring Multi-Turn Guardrail Degradation and Judge Reliability in Large Language Models

    Using ADVERSA to measure guardrail degradation and reviewer reliability under multi-turn attacks

    Published
    Evaluated models
    Claude Opus 4.6, Gemini 3.1 Pro, GPT-5.2
    AbstractADVERSA measures multi-turn guardrail changes using per-turn compliance trajectories and three-reviewer consensus.

    ADVERSA is an automated multi-turn red-teaming measurement framework that records guardrail behavior as per-turn compliance trajectories and simultaneously measures whether reviewers agree. The problem it addresses: single-turn binary pass/fail cannot show how safety properties change under sustained adversarial pressure, nor can it separate gradual refusal consolidation from stable scores. The authors argue that real-world adversaries rewrite and persist over multiple turns.

    Paper analysisRead analysis
  11. AttacksarXiv 2602.00364

    "Someone hid it": Query-agnostic black-box attacks against LLM retrieval

    提出查询无关黑盒攻击 DQ-A,用可迁移文末后缀降低文档检索排名

    Published
    Evaluated models
    Qwen-1.5-7B-Instruct, SFR-Embedding-Mistral, E5-Mistral-7B-Instruct and others10
    AbstractDQ-A 以无查询黑盒后缀压低 LLM 检索排名,并在 BRIGHT 上比较三种基线。

    DQ-A 是一种 query-agnostic、complete black-box 的文档隐藏攻击,对象是用最后隐层相似度匹配的 LLM 检索。

    Paper analysisRead analysis
  12. AttacksarXiv 2512.01335

    EmoRAG 研究揭示 RAG 检索对表情符号扰动的脆弱性

    提出 EmoRAG,向查询与知识库注入同一表情以劫持 RAG 检索

    Published
    Evaluated models
    SPECTER, Contriever, Qwen2-7B and others11
    AbstractEmoRAG 用表情联动查询与库文本。

    EmoRAG 测量 RAG 对符号扰动的反应:同一表情同时出现在查询和库文本里时,检索会偏离语义匹配。作者要检查的是,检索是否真由语义相关性决定。

    Paper analysisRead analysis
  13. AttacksarXiv 2511.16110

    MFA 框架在 17 个视觉语言模型上取得 58.5% 攻击成功率

    提出 MFA 框架,协同突破视觉语言模型的对齐、提示与审核层

    Published
    Attacker
    Black-box
    Evaluated models
    MiniGPT-4, LLaMA-4-Scout-Inst, LLaMA-3.2-11B-Vision-Instruct and others17

    Abstract作者称多层防御的 VLM 仍存在跨模型漏洞,MFA 整合三项技术实现了端到端越狱。

    Paper analysisRead analysis
You have reached the end