Skip to content

Translation in progress Some entries still include text in the original language.

Oct 12 · Monday

All papers

Found 11 papers
Filter2

Attack type

Jailbreaks11Prompt injection66Poisoning and backdoors23Extraction and theft3Malicious use8

Defense type

Detection and filtering4

Impact

Harmful content7Unauthorized actions3

System type

AI Agent10

Attack surface / entry point

User input11Tool responses3

Layer

Prompt layer36Model layer5Application layer11

System component

Guardrails and judges5
Select any value within a category; different categories must all match. Counts include the other filters you have selected.Another 254papers have no tags yet and are not included in filtered results.
Attack type：JailbreaksLayer：Application layerClear all

Another 254papers do not have category tags yet and are not included in filtered results.

  1. Evaluation and benchmarksarXiv 2610.07089

    研究者提出统一滥用监控基准，覆盖分解攻击与提示注入约 6200 条轨迹

    提出危害窗口与区间指标，统一评测分解攻击和提示注入下的智能体滥用监视

    arXiv
    2610.07089
    Published
    Layer
    Application layer
    Setting
    AI Agent
    Evaluated models
    Gemma 4 26B-A4B, Qwen3.6 27B, Qwen3.5 27B and others12

    Abstract统一智能体滥用监视框架，动作视角兼顾两类威胁但危害定位仍存瓶颈。

    Paper analysisRead analysis
  2. Evaluation and benchmarksarXiv 2610.03434

    Persona Guardrail：面向智能体系统的生产级防御框架

    提出 Persona Guardrail，强制客服智能体守住功能边界

    arXiv
    2610.03434
    Published
    Layer
    Application layer
    Setting
    AI Agent
    Attacker
    Black-box
    Evaluated models
    Qwen3-30B-A3B, Qwen3-VL-30B, Qwen3-8B and others5
    AbstractPersona Guardrail 用功能边界做同步输入输出校验，并在 PAGE 与生产延迟预算下给出评测。

    Persona Guardrail 是客服向智能体的同步运行时防御：先写明功能边界，再决定放行或拦截，而不是只检测某一攻击类。

    Paper analysisRead analysis
  3. Evaluation and benchmarksarXiv 2609.27336

    CART：面向大语言模型的闭环自适应红队框架

    提出闭环自适应红队框架 CART，评测模型与 Agent 的安全失败

    arXiv
    2609.27336
    Published
    Layer
    Application layer
    Setting
    AI Agent
    Evaluated models
    Claude Opus 4.8, GPT-5.5, Grok 4.3 and others7
    AbstractCART 把红队做成可审计的闭环搜索，在三类评测上比静态回放发现更多失败与更高平均风险。

    CART 把自动红队从一次清单式打分，改成带预算、可追溯的闭环搜索。

    Paper analysisRead analysis
  7. Evaluation and benchmarksarXiv 2601.10156

    ToolSafe 提出步骤级护栏 TS-Guard 与 TS-Flow，降低 Agent 有害工具调用

    提出 TS-Guard 与 TS-Flow，在执行前检测并引导 Agent 修正有害工具调用

    arXiv
    2601.10156
    Published
    Layer
    Application layer
    Setting
    AI Agent
    Evaluated models
    GPT-4o, TS-Guard, Qwen2.5-14B-Instruct
    AbstractTS-Bench 标步骤级风险，TS-Guard 用多任务 RL 做执行前判定，TS-Flow 用反馈代替直接中止。

    ToolSafe 研究 LLM 智能体在工具执行前的步骤级安全：基准 TS-Bench、护栏 TS-Guard，以及反馈驱动框架 TS-Flow。

    Paper analysisRead analysis
  9. Evaluation and benchmarksarXiv 2510.01359

    JAWS-Bench：研究者用三种工作区场景系统越狱代码 Agent

    提出 JAWS-Bench，评测代码 Agent 在三级工作区中的越狱与恶意代码可执行性

    arXiv
    2510.01359
    Published
    Layer
    Application layer
    Setting
    coding agent
    Evaluated models
    GPT-4.1, GPT-o1, DeepSeek-R1 and others8

    Abstract论文提出了评估代码智能体端到端恶意代码越狱的 JAWS-Bench，发现多文件与智能体推理会明显放大可部署危害。

    Paper analysisRead analysis
  10. Evaluation and benchmarksarXiv 2505.23559

    SafeScientist：让 LLM 智能体的科学发现具备风险意识

    提出 SafeScientist 四层监控，阻止科研智能体执行高风险或不伦理任务

    arXiv
    2505.23559
    Published
    Layer
    Application layer
    Setting
    science agent, Multi-agent systems
    Evaluated models
    GPT-4o, GPT-4.1, GPT-3.5-turbo and others5
    Abstract四层监控加科研安全基准。

    SafeScientist 是带四层监控的科研智能体框架，并用 SciSafetyBench 评测科学场景中的任务安全。

    Paper analysisRead analysis
You have reached the end