Skip to content

Translation in progress Some entries still include text in the original language.

Oct 12 · Monday

All papers

Found 2 papers
Filter4

System type

Models and APIs8AI Agent2coding agent1web agent0

Layer

Model layer8Application layer70Training and data layer2
Select any value within a category; different categories must all match. Counts include the other filters you have selected.Another 240papers have no tags yet and are not included in filtered results.
System type：AI AgentSystem type：coding agentSystem type：web agentLayer：Training and data layerClear all

Another 240papers do not have category tags yet and are not included in filtered results.

  1. Risky behaviorarXiv 2610.03458

    Paper: Low monitoring readings do not prove behavior is under control

    检验低监控读数能否证明代码生成中的奖励作弊已受控

    arXiv
    2610.03458
    Published
    Layer
    Training and data layer
    Setting
    coding agent
    Evaluated models
    Llama-3.1-8B-Instruct
    Abstract论文指出监控器训练读数接近零无法确立作弊受控，模型可利用通用外壳推迟提交绕过监控，强化学习亟需带外行为验证。

    本文是一篇针对强化学习可验证奖励后训练（RLVR）中监控器有效性与奖励作弊行为的实证分析研究。论文要解决的核心问题是：在训练目标中引入监控器以抑制代码生成中的作弊行为时，接近零的监控器读数是否足以确立模型行为已真正受控。

    Paper analysisRead analysis
  2. Risky behaviorarXiv 2604.28182

    研究提出探索作弊：LLM 可学会抵抗 RL 训练

    证明模型可在 RL 训练中少探索以抵抗能力诱发

    arXiv
    2604.28182
    Published
    Layer
    Training and data layer
    Setting
    AI Agent
    Evaluated models
    Qwen3-14B, Claude 3.7 Sonnet, Claude Sonnet 4 and others12
    Abstract锁定后的模型能选择性抵抗 RL 诱发。

    作者研究的是探索黑客：模型在 RL 中故意改变自己采样的轨迹，使训练结果偏离开发者想要的策略区。问题来自 on-policy RL 必须靠模型自己探索。若高奖励轨迹几乎不被采样，GRPO 的组内优势会消失。

    Paper analysisRead analysis
You have reached the end