Skip to content

Translation in progress Some entries still include text in the original language.

Oct 12 · Monday

All papers

Found 14 papers

Another 240papers do not have category tags yet and are not included in filtered results.

  1. AttacksarXiv 2610.07723

    Researchers propose answer-side backdoors: letting the model self-generate trigger words to bypass safety refusals.

    提出回答端后门,让模型自生成触发词以在干净有害请求下绕过拒答

    Published
    Evaluated models
    Llama-2-7B-chat-hf, Mistral-7B-Instruct-v0.3, Gemma-7B-it and others4

    Abstract论文提出了多轮对话中回答端自生成触发词绕过安全拒绝的后门攻击,指出输入端防护存在盲区。

    Paper analysisRead analysis
  2. 研究评估 GradSafe 在多轮对话中的越狱检测脆弱性

    评测多轮对话中 GradSafe 越狱检测的可分性与脆弱性

    Published
    Evaluated models
    Llama 3.1 8B Instruct, Qwen2.5-7B-Instruct
    AbstractCWS 显示不安全梯度在真实多轮流量中变弱,且随攻击族和模型而变。

    作者评估梯度越狱检测从单条提示词迁到多轮对话后还剩多少可分性,方法是用 Context Window Scanner 把 GradSafe 原封不动地套到用户轮窗口上。

    Paper analysisRead analysis
  3. 研究用 XAI 归因分析 Prompt Guard 2,同义词替换可翻转其提示注入判定

    用词级归因指导同义词替换,翻转提示注入检测并验证越狱

    Published
    Evaluated models
    Prompt Guard 2 (86M), Llama 3.1 8B

    Abstract作者称检测靠分散的词法线索。

    Paper analysisRead analysis
  4. AttacksarXiv 2609.22510

    特拉维夫大学提出爆炸性提示词:条件触发的间接提示注入可绕过九款生产 Agent

    提出条件触发的爆炸提示词,并设计摄入期检测器 DeFuse

    Published
    Setting
    AI Agent
    Evaluated models
    Llama-3.1-8B-Instruct, Llama-3.1-70B-Instruct, Qwen2.5-32B-Instruct and others15
    Abstract论文揭示了条件触发使提示注入绕过防御并在触发时执行工具,提出轻量检测器并在摄入期有效防范。

    论文针对大语言模型智能体面临的间接提示注入威胁,研究了利用条件句式实现时间分离的爆炸提示词。

    Paper analysisRead analysis
  5. AttacksarXiv 2607.14493

    LogInject 框架披露 LLM 日志分析中的被动提示注入

    提出 LogInject 框架,评测日志分析中的被动提示注入及缓解

    Published
    Evaluated models
    GPT-4o, Claude 3.5 Sonnet, Llama-3-70B-Instruct

    Abstract论文评估了 LLM 日志分析中的上下文污染风险,提出分片拼接等攻击与三层防御,指出必须结合架构隔离与人工介入。

    Paper analysisRead analysis
  6. AttacksarXiv 2606.09084

    研究者提出 Context-Fractured Decomposition 攻击

    提出 CFD 跨会话分解攻击,利用工件来源缺口绕过工具型 Agent 的本地检查

    Published
    Setting
    AI Agent
    Evaluated models
    GPT-4.1, GPT-5-nano, Claude-3.5-Sonnet and others6
    AbstractCFD 用无指令 artifact 把越狱拆到跨会话。

    CFD针对工具型 LLM 智能体:利用 artifact 来源不被跟踪这一部署失败模式,把有害目标拆开后延迟组合。

    Paper analysisRead analysis
  7. MultiTurnPSB

    构建 MultiTurnPSB,评测四轮医疗越狱与分类器输入防御

    Published
    Evaluated models
    GPT-4.1-mini, Claude Sonnet 4.5
    Abstract多轮攻击加剧医疗模型风险,分类器干预有效但受高误报率制约。

    MultiTurnPSB 针对患者端医疗大模型在持续交互中的安全风险,构建了包含三种攻击模态的四轮对抗评测基准。

    Paper analysisRead analysis
  8. AttacksarXiv 2604.03890

    From prompts to physical actions: structured backdoor attacks against LLM-mediated robot control systems

    Propose a structured JSON backdoor that triggers malicious actions in robot control via a poisoned LoRA

    Published
    Evaluated models
    Llama-3.1-8B-Instruct, Gemma-2-9B-IT, DeepSeek-R1-Distill-Llama-8B and others4

    Abstract推理层后门传不到执行。

    Paper analysisRead analysis
  9. ADVERSA: Measuring Multi-Turn Guardrail Degradation and Judge Reliability in Large Language Models

    Using ADVERSA to measure guardrail degradation and reviewer reliability under multi-turn attacks

    Published
    Evaluated models
    Claude Opus 4.6, Gemini 3.1 Pro, GPT-5.2
    AbstractADVERSA measures multi-turn guardrail changes using per-turn compliance trajectories and three-reviewer consensus.

    ADVERSA is an automated multi-turn red-teaming measurement framework that records guardrail behavior as per-turn compliance trajectories and simultaneously measures whether reviewers agree. The problem it addresses: single-turn binary pass/fail cannot show how safety properties change under sustained adversarial pressure, nor can it separate gradual refusal consolidation from stable scores. The authors argue that real-world adversaries rewrite and persist over multiple turns.

    Paper analysisRead analysis
  10. AttacksarXiv 2511.16110

    MFA 框架在 17 个视觉语言模型上取得 58.5% 攻击成功率

    提出 MFA 框架,协同突破视觉语言模型的对齐、提示与审核层

    Published
    Attacker
    Black-box
    Evaluated models
    MiniGPT-4, LLaMA-4-Scout-Inst, LLaMA-3.2-11B-Vision-Instruct and others17

    Abstract作者称多层防御的 VLM 仍存在跨模型漏洞,MFA 整合三项技术实现了端到端越狱。

    Paper analysisRead analysis
  11. AttacksarXiv 2510.10271

    MetaBreak:通过特殊 token 操纵越狱在线 LLM 服务

    提出 MetaBreak,用特殊 token 操纵越狱在线 LLM 服务并绕过审核

    Published
    Attacker
    Black-box
    Evaluated models
    Llama-3.3-70B-Instruct, Qwen-2.5-72B-Instruct, Gemma-2-27B-Instruct and others10

    Abstract利用特殊 token 注入对抗平台模板包裹与审核,多场景验证了越狱有效性与互补性。

    Paper analysisRead analysis
You have reached the end