Skip to content
Oct 12 · Monday

All papers

Found 1 paper
Filter5
Select any value within a category; different categories must all match. Counts include the other filters you have selected.Another 240papers have no tags yet and are not included in filtered results.

Another 240papers do not have category tags yet and are not included in filtered results.

  1. The Continuation vs. Refusal Debate: Mechanism Analysis of Continuation-Triggered Jailbreaks in Large Language Models

    Analyzing the attention head mechanism of continuation-triggered jailbreaks and proposing HCS

    Published
    Evaluated models
    LLaMA-2-7B-Chat, Qwen2.5-7B-Instruct
    AbstractThe authors state that jailbreaks arise from competition between two types of heads, and that HCS plus distillation can use this competition for inference-time intervention.

    The authors use attention head mechanism analysis for continuation-triggered jailbreaks: under the same harmful instruction, moving the continuation suffix from after the instruction to outside the prompt boundary makes the model more likely to continue generating along the suffix.

    Paper analysisRead analysis
You have reached the end