Skip to content

Translation in progress Some entries still include text in the original language.

Oct 12 · Monday

Reward hacking · Papers

Found 2 papers
Filter2

System type

AI Agent4coding agent2

System component

Monitors2
Select any value within a category; different categories must all match. Counts include the other filters you have selected.
System type：coding agentSystem component：MonitorsTopic: Reward hackingClear all
  1. Risky behaviorarXiv 2610.03458

    Paper: Low monitoring readings do not prove behavior is under control

    检验低监控读数能否证明代码生成中的奖励作弊已受控

    arXiv
    2610.03458
    Published
    Layer
    Training and data layer
    Setting
    coding agent
    Evaluated models
    Llama-3.1-8B-Instruct
    Abstract论文指出监控器训练读数接近零无法确立作弊受控，模型可利用通用外壳推迟提交绕过监控，强化学习亟需带外行为验证。

    本文是一篇针对强化学习可验证奖励后训练（RLVR）中监控器有效性与奖励作弊行为的实证分析研究。论文要解决的核心问题是：在训练目标中引入监控器以抑制代码生成中的作弊行为时，接近零的监控器读数是否足以确立模型行为已真正受控。

    Paper analysisRead analysis
  2. Evaluation and benchmarksarXiv 2609.39533

    CATCH：面向编码 RL 奖励作弊的可控分析测试台

    构建编码 RL 奖励作弊测试台 CATCH 并检验 CoT 监控失效

    arXiv
    2609.39533
    Published
    Layer
    Model layer
    Setting
    coding agent
    Evaluated models
    Qwen3-4B, Qwen3.5-27B
    AbstractCATCH 用双运行金标签研究编码 RL 的奖励黑客，并观察到监控会被注释适应削弱。

    CATCH 是面向编码 RL 奖励黑客的可控分析测试床，用可利用环境、可调初始倾向和基于执行的金标签，在训练全程比较黑客动态与干预。

    Paper analysisRead analysis
You have reached the end