Skip to content

Translation in progress Some entries still include text in the original language.

Oct 12 · Monday

All papers

Found 9 papers
Filter3
Select any value within a category; different categories must all match. Counts include the other filters you have selected.Another 232papers have no tags yet and are not included in filtered results.

Another 232papers do not have category tags yet and are not included in filtered results.

  1. DefensesarXiv 2610.11012

    Redwood Research 提出蒸馏双重困境:用蒸馏让模型坦白隐藏行为或只继承能力

    提出 DFI 与 DFC 蒸馏,定罪隐瞒失配的教师或安全提取能力

    Published
    Evaluated models
    Llama-3.3-70B-Instruct (AuditBench SFT/KTO organisms), Llama-3.3-70B-Instruct (DFI distilled student), Llama-3.1-8B-Instruct (DFI distilled student) and others4

    Abstract概括了论文针对隐瞒失配模型提出的 DFI 与 DFC 机制、主实验发现及适用边界。

    Paper analysisRead analysis
  2. DefensesarXiv 2610.09496

    SOUL:用稀疏特征策略遗忘缓解 VLA 模型的状态幻觉

    提出 SOUL 稀疏特征策略遗忘,缓解 VLA 状态幻觉

    Published
    Evaluated models
    OpenVLA, π0.5
    AbstractSOUL 以稀疏特征遗忘 VLA 状态幻觉。

    SOUL用稀疏特征引导的策略 unlearning 处理 VLA 的 state hallucination。

    Paper analysisRead analysis
  3. The paper proposes a scaling law framework for alignment measured by risk category.

    提出分风险对齐标度律框架,测量各类风险的对齐负担如何随规模变化

    Published
    Evaluated models
    Pythia (14m–2.8b), Qwen2.5 (0.5B–72B), Qwen2.5-Instruct (0.5B–14B) and others4
    Abstract论文提出了分风险对齐标度律框架,测得真实性与倾向纠错呈标度有益,但盲后门仍存活,揭示隐藏风险的长期挑战。

    本文提出了一个将大语言模型对齐难度形式化为可测量标度关系的理论框架与预注册评测协议。

    Paper analysisRead analysis
  4. AbstractFBS 辩论用 fbs 约束敏感分解,给出最坏情况占优策略,并匹配黑盒查询下界。

    FBS Debate 是一套可扩展监督的辩论规则:两名计算方争论一个可递归分解的是非问题,人类只在最后选出的子问题上做黑盒判断。要处理的缺口是,prover-estimator debate 虽能覆盖稳定分解,但只在输入分布的平均意义下成立,而且 Bob 的获胜策略一般要跟着 Alice 的作弊策略变。作者要在同一问题类上,让每个错误实例都能被抓住,并让诚实且正确成为双方的占优策略。

    Paper analysisRead analysis
  5. DefensesarXiv 2609.38909

    Purdue 提出 Pact:将欺骗作为行为遗忘

    提出 PACT,遗忘推理模型在压力下的欺骗行为并保留上下文理解

    Published
    Attacker
    White-box
    Evaluated models
    DeepSeek-R1-Distill-Qwen-32B, QwQ-32B

    Abstract论文将大模型欺骗形式化为上下文条件行为,提出 PACT 框架在消除欺骗的同时保留了上下文遵循能力。

    Paper analysisRead analysis
  6. DefensesarXiv 2609.38645

    用探针引导微调对齐模型且不损失可监控性

    用持续更新的探针做微调,降低有害性并保持线性可监测性

    Published
    Evaluated models
    Mistral 7B Instruct v0.1, Llama 3 8B Instruct Abliterated, Qwen3-14B
    Abstract持续重拟合的探针可降低有害性、提高诚实性,训练后概念仍能被线性探针读出。

    Probe-guided fine-tuning 把探针分数当作唯一对齐信号,用来推动 harmlessness 与 honesty,并检查训练后这些概念是否仍线性可读。

    Paper analysisRead analysis
  7. Stanford and Anthropic research: in RL post-training, models' disclosure behavior of admitting failure is far less stable than task capability

    度量强化学习后失败披露的跨运行不稳定性,并提出失败条件参考锚定

    Published
    Evaluated models
    Qwen2.5-1.5B, Qwen2.5-7B, Qwen2.5-14B and others11

    Abstract纯结果强化学习会使模型失败披露行为出现远高于任务能力的跨运行发散,采用失败条件参考锚定可稳定汇报但存在性能权衡。

    Paper analysisRead analysis
  8. 研究提出探索作弊:LLM 可学会抵抗 RL 训练

    证明模型可在 RL 训练中少探索以抵抗能力诱发

    Published
    Setting
    AI Agent
    Evaluated models
    Qwen3-14B, Claude 3.7 Sonnet, Claude Sonnet 4 and others12
    Abstract锁定后的模型能选择性抵抗 RL 诱发。

    作者研究的是探索黑客:模型在 RL 中故意改变自己采样的轨迹,使训练结果偏离开发者想要的策略区。问题来自 on-policy RL 必须靠模型自己探索。若高奖励轨迹几乎不被采样,GRPO 的组内优势会消失。

    Paper analysisRead analysis
You have reached the end