Skip to content
EventPast event

ATTCK-R: A Long-Range Jailbreak Framework for Protected LLMs

1 reports1 reporting sourcesLatest report

Start here

AI overview

The researchers propose a multi-turn red-teaming framework, ATTCK-R, for jailbreak testing on black-box systems equipped with prompt-based safety defenses. The paper reports that after adding a layer of prompt-based safety defense, a strong multi-turn baseline's average attack success rate drops from 0.896 to 0.608, a relative decrease of 32.1%, indicating that evaluations without defenses significantly overestimate real-world deployment vulnerabilities. ATTCK-R models jailbreaking as a long-horizon trajectory optimization problem, uses a structured belief state, distills reusable strategies from past successes and failures via optimization-based strategy screening, and uses informed backtracking to continue attacks from strategically meaningful states rather than restarting.

Generated by AI from reports · Updated 29 days ago

Attention and developments

Attention, hourly

Now 33, 0% in 24 hours·Peak 33 (Nov 6 04:00)

Nov 7Nov 8Nov 9Nov 10Nov 11Now 33

Related research

This event's paper

Progress timeline

Oct 12
  1. arXiv: Jailbreaks, Prompt Injection, Poisoning & Defenses
    ATTCK-R: A Knowledge-Aware Long-Horizon Jailbreak Framework for Protected LLMs

    The researchers propose a multi-turn red-teaming framework ATTCK-R for conducting jailbreak tests on black-box systems equipped with prompt-based safety defenses. The paper reports that after introducing a layer of prompt-based safety defense, the average attack success rate of a strong multi-turn baseline drops from 0.896 to 0.608, a relative decrease of 32.1%, indicating that evaluations without defenses significantly overestimate vulnerability in real deployments. ATTCK-R models jailbreaking as a long-horizon trajectory optimization problem, uses structured belief states, distills reusable strategies from past successes and failures through optimization-based strategy screening, and uses informed backtracking to continue attacks from strategically meaningful states rather than restarting. Across 9 common LLMs configured with a single layer of prompt-based safety defense, ATTCK-R consistently outperforms recent strong multi-turn jailbreak frameworks. Ablation results show that long-horizon planning and strategy screening improve attack effectiveness, while adaptive backtracking improves efficiency by structurally recovering from conversation failures.

Related discussion

No discussion links have been collected for this event yet.

Attention trend

Hourly attention

Current attention 33·Peak in the comparable period 33 (Nov 6 04:00)·Change over the comparable past 24 hours 0%

010203040Nov 604:00Nov 800:00Nov 919:00Nov 1115:00