Skip to content

Translation in progress Some entries still include text in the original language.

Oct 12 · Monday

All papers

Found 4 papers
Filter5
Select any value within a category; different categories must all match. Counts include the other filters you have selected.Another 255papers have no tags yet and are not included in filtered results.

Another 255papers do not have category tags yet and are not included in filtered results.

  1. AttacksarXiv 2610.06670

    研究者提出 Reward Stealing Attack,从对齐模型行为反推安全奖励实施攻击

    提出 ReSA,从对齐模型行为恢复安全奖励并在解码时反转

    Published
    Evaluated models
    Llama3.1-8B-Instruct, Gemma-7B-Instruct, Qwen2.5-7B-Instruct and others9
    AbstractReSA 用最大熵 IRL 从对齐模型行为恢复代理安全奖励,并在解码时反转以诱导有害输出。

    ReSA 是一种对抗攻击:从对齐模型的可观察行为恢复代理安全奖励,再在解码时把该奖励反过来用。。

    Paper analysisRead analysis
  2. 续写与拒答之争:大语言模型中续写触发越狱的机制分析

    分析续写触发越狱的注意力头机制并提出 HCS

    Published
    Evaluated models
    LLaMA-2-7B-Chat, Qwen2.5-7B-Instruct
    Abstract作者称越狱来自两类头竞争,HCS 加蒸馏可把该竞争用于推理时干预。

    作者用注意力头机制分析 continuation-triggered jailbreak:同一有害指令下,把 continuation 后缀从指令后面挪到提示词边界外,模型更容易顺着后缀继续生成。

    Paper analysisRead analysis
You have reached the end