Skip to content

Translation in progress Some entries still include text in the original language.

Oct 12 · Monday

Defenses and guardrails · Papers

Found 4 papers
Filter2
Select any value within a category; different categories must all match. Counts include the other filters you have selected.
  1. DefensesarXiv 2609.02786

    SafeEvolve:基于智能体经验的 Harness-Policy 协同演化安全对齐框架

    提出 SafeEvolve,用轨迹证据协同演化安全 harness 与策略

    Published
    Setting
    AI Agent
    Evaluated models
    Qwen3.5-4B, Qwen3-4B-Instruct-2507, Qwen3.5-1.7B and others4
    AbstractSafeEvolve 用轨迹证据协同更新安全 harness 和策略,在两个 4B 模型的智能体安全基准上改变安全与效用。

    SafeEvolve 把已完成的 on-policy 轨迹变成安全 harness 的有界更新,并用两阶段 SFT-RL 把这些更新内化进工具使用策略。

    Paper analysisRead analysis
  2. DefensesarXiv 2601.10156

    ToolSafe 提出步骤级护栏 TS-Guard 与 TS-Flow,降低 Agent 有害工具调用

    提出 TS-Guard 与 TS-Flow,在执行前检测并引导 Agent 修正有害工具调用

    Published
    Setting
    AI Agent
    Evaluated models
    GPT-4o, TS-Guard, Qwen2.5-14B-Instruct
    AbstractTS-Bench 标步骤级风险,TS-Guard 用多任务 RL 做执行前判定,TS-Flow 用反馈代替直接中止。

    ToolSafe 研究 LLM 智能体在工具执行前的步骤级安全:基准 TS-Bench、护栏 TS-Guard,以及反馈驱动框架 TS-Flow。

    Paper analysisRead analysis
You have reached the end