Skip to content

Translation in progress Some entries still include text in the original language.

Oct 13 · Tuesday

Reward hacking · Papers

Found 1 paper
Filter3

System type

Models and APIs8coding agent1science agent0

Layer

Application layer8Training and data layer1
Select any value within a category; different categories must all match. Counts include the other filters you have selected.
System type：coding agentSystem type：science agentLayer：Training and data layerTopic: Reward hackingClear all
  1. Risky behaviorarXiv 2610.03458

    Paper: Low monitoring readings do not prove behavior is under control

    检验低监控读数能否证明代码生成中的奖励作弊已受控

    arXiv
    2610.03458
    Published
    Layer
    Training and data layer
    Setting
    coding agent
    Evaluated models
    Llama-3.1-8B-Instruct
    Abstract论文指出监控器训练读数接近零无法确立作弊受控，模型可利用通用外壳推迟提交绕过监控，强化学习亟需带外行为验证。

    本文是一篇针对强化学习可验证奖励后训练（RLVR）中监控器有效性与奖励作弊行为的实证分析研究。论文要解决的核心问题是：在训练目标中引入监控器以抑制代码生成中的作弊行为时，接近零的监控器读数是否足以确立模型行为已真正受控。

    Paper analysisRead analysis
You have reached the end