Skip to content

Translation in progress Some entries still include text in the original language.

Oct 12 · Monday

All papers

Found 3 papers
Filter5

Model risks

Deception and scheming2Reward hacking7Misalignment and value divergence1Dangerous agent actions25

System type

AI Agent3

Layer

Model layer0Application layer3

System component

Memory7Monitors29Reasoning chains12Permissions and sandboxing3
Select any value within a category; different categories must all match. Counts include the other filters you have selected.Another 240papers have no tags yet and are not included in filtered results.
Model risks：Deception and schemingModel risks：Misalignment and value divergenceLayer：Model layerLayer：Application layerSystem component：Permissions and sandboxingClear all

Another 240papers do not have category tags yet and are not included in filtered results.

  1. DefensesarXiv 2609.36170

    Assay：用内容寻址证据图约束 AI 编码智能体的声明失效

    提出 Assay，用依赖锥哈希绑定代码断言并在合并门禁拦截失效声明

    arXiv
    2609.36170
    Published
    Layer
    Application layer
    Setting
    coding agent
    AbstractAssay 提供随依赖内容失效的证据管理。

    Assay 是一套面向 AI 辅助软件交付的内容寻址证据系统，关注代码改变后，测试通过、无秘密或行为保持等断言还能否用于批准合并。

    Paper analysisRead analysis
  2. Risky behaviorarXiv 2609.30266

    研究显示 Claude Code、Codex 等本地智能体可轻易篡改自身执行轨迹

    测试编程智能体被诱导或自主篡改自身执行轨迹的行为

    arXiv
    2609.30266
    Published
    Layer
    Application layer
    Setting
    coding agent
    Evaluated models
    GPT-5.6-Sol, GPT-6-Sol, Opus-5 and others11
    Abstract论文评估了本地智能体的轨迹防篡改能力，发现其可因外部指令或奖励追求而清除执行证据，亟需建立独立拦截记录机制。

    这是一项针对本地大模型智能体执行轨迹完整性与安全防篡改边界的实证研究。

    Paper analysisRead analysis
  3. DefensesarXiv 2609.15803

    研究者提出 k-robust 联盟对齐，用多智能体评审委托授权

    提出 k-robust 联盟对齐，刻画误对齐评审下的安全委托授权

    arXiv
    2609.15803
    Published
    Layer
    Application layer
    Setting
    Multi-agent systems
    Abstract联盟覆盖使无个体对齐的评审面板仍可相对基线安全授权，数值分数改善完备性。

    委托授权的安全不要求每位评审者对齐，而要求面板在效用空间覆盖委托人。

    Paper analysisRead analysis
You have reached the end