Skip to content

Translation in progress Some entries still include text in the original language.

Failure-First·Indexed by this site · Originally published

CRAFT:用隐表示对比学习对齐推理模型,降低越狱攻击成功率

[Daily Paper] Contrastive Reasoning Alignment: Reinforcement Learning from Hidden Representations

AI summary

CRAFT 通过隐空间的隐表示优化与对比学习对齐推理模型,让安全贯穿整条思维链而非只过滤最终输出。该框架用 GRPO 结合输出层安全评估与隐空间对齐分数,并加入隐—文本一致性项,在 Qwen3-4B-Thinking 与 R1-Distill-Llama-8B 上降低越狱攻击成功率,同时保持标准推理基准表现。评测限于单轮攻击,多轮越狱与长推理链泛化仍未解决。

Read originalfailurefirst.org