Redwood Research 提出蒸馏双重困境:用蒸馏让模型坦白隐藏行为或只继承能力
提出 DFI 与 DFC 蒸馏,定罪隐瞒失配的教师或安全提取能力
- arXiv
- 2610.11012
- Published
- Setting
- Models and APIs
- Evaluated models
- Llama-3.3-70B-Instruct (AuditBench SFT/KTO organisms), Llama-3.3-70B-Instruct (DFI distilled student), Llama-3.1-8B-Instruct (DFI distilled student) and others4
- DefensesMonitoring and auditing
- RiskDeception and scheming
Abstract概括了论文针对隐瞒失配模型提出的 DFI 与 DFC 机制、主实验发现及适用边界。