Skip to content
EventPast event

Multi-turn jailbreaks exhibit effective horizon compression

1 reports1 reporting sourcesLatest report

Start here

AI overview

An arXiv paper proposes the concept of "effective horizon" in multi-turn jailbreaks: after deleting early attack queries, rerunning the remaining queries in a new conversation and regenerating model responses, on average about half of the original query sequence suffices to recover the same attack progress, which the authors call effective horizon compression. The study states that this shorter history can recover the best point reached in unsuccessful attacks, providing a better starting point for continuing the attack; the result can also be used to identify which early queries should receive less learning signal in attacker training, and downweighting them improves performance, while a shorter reward propagation window can also maintain calibration defense performance close to that of the full trajectory.

Generated by AI from reports · Updated 25 days ago

Attention and developments

Attention, hourly

Now 32, 0% in 24 hours·Peak 32 (Nov 6 04:00)

Nov 7Nov 8Nov 9Nov 10Nov 11Nov 12Nov 13Now 32

Related research

This event's paper

Progress timeline

Oct 16
  1. arXiv: Jailbreaks, Prompt Injection, Poisoning & Defenses
    Multi-turn short horizon: measuring effective horizon compression in jailbreaks

    Researchers propose the concept of "effective horizon" in multi-turn jailbreaks. By deleting early attack queries and rerunning the remaining queries in a new conversation, regenerating model replies, they find that on average about half of the original query sequence is sufficient to recover the same attack progress. The authors call this phenomenon effective horizon compression, and state that this shorter history can recover the best point reached in unsuccessful attacks, providing a better starting point for continuing the attack. The results can also be used to identify which early queries should receive less learning signal in attacker training; down-weighting them improves performance; a shorter reward propagation window also maintains calibrated defense performance close to that of full trajectories.

Related discussion

No discussion links have been collected for this event yet.

Attention trend

Hourly attention

Current attention 32·Peak in the comparable period 32 (Nov 6 04:00)·Change over the comparable past 24 hours 0%

010203040Nov 604:00Nov 812:00Nov 1019:00Nov 1303:00