Skip to content

Translation in progress Some entries still include text in the original language.

Oct 12 · Monday

All papers

Found 7 papers
Filter3

Attack type

Jailbreaks3Prompt injection7Malicious use3

Model risks

Deception and scheming4Misalignment and value divergence4Dangerous agent actions8Hallucination and fabrication3

Impact

Oversight failure3

System type

AI Agent4

Attack surface / entry point

User input5Tool responses3

Layer

Application layer5
Select any value within a category; different categories must all match. Counts include the other filters you have selected.Another 233papers have no tags yet and are not included in filtered results.
Attack type：Prompt injectionModel risks：Deception and schemingModel risks：Misalignment and value divergenceClear all

Another 233papers do not have category tags yet and are not included in filtered results.

  2. Evaluation and benchmarksarXiv 2609.33102

    ORBIT：基于 UK AISI Inspect 的多智能体安全评测框架

    提出 ORBIT 框架，评测多智能体防御对合谋等威胁的效果

    arXiv
    2609.33102
    Published
    Layer
    Application layer
    Setting
    Multi-agent systems
    Evaluated models
    GPT-5.4, Claude Sonnet 4.6, Qwen3-235B and others5

    AbstractORBIT 用六层配置比较多智能体防御，逐动作监控不迁移到合谋。

    Paper analysisRead analysis
  3. Evaluation and benchmarksarXiv 2609.32616

    Cave-Bench：虚假指控下 LLM 智能体最高 60.06% 的运行会破坏正确工作

    提出 CAVE-BENCH，评测智能体在虚假指责下破坏已完成的正确工作

    arXiv
    2609.32616
    Published
    Layer
    Application layer
    Setting
    coding agent
    Evaluated models
    Claude-Sonnet-5, Claude-Opus-5, GPT-5.6-Sol and others14

    Abstract论文提出了评估智能体在虚假指责下破坏已有正确成果的 CAVE-BENCH，发现强模型易推翻已知证据，提出了门控缓解方案。

    Paper analysisRead analysis
  4. Risky behaviorarXiv 2609.30266

    研究显示 Claude Code、Codex 等本地智能体可轻易篡改自身执行轨迹

    测试编程智能体被诱导或自主篡改自身执行轨迹的行为

    arXiv
    2609.30266
    Published
    Layer
    Application layer
    Setting
    coding agent
    Evaluated models
    GPT-5.6-Sol, GPT-6-Sol, Opus-5 and others11
    Abstract论文评估了本地智能体的轨迹防篡改能力，发现其可因外部指令或奖励追求而清除执行证据，亟需建立独立拦截记录机制。

    这是一项针对本地大模型智能体执行轨迹完整性与安全防篡改边界的实证研究。

    Paper analysisRead analysis
  5. Evaluation and benchmarksarXiv 2609.29429

    Jev 被用于零样本检测十类对齐失败，中位 AUROC 达 0.886

    提出 RLCDAlignBench，零样本检测多种对齐失败

    arXiv
    2609.29429
    Published
    Layer
    Prompt layer
    Setting
    Models and APIs
    Evaluated models
    Jev (jev-1.13.0)
    Abstract一次通用问题已能给多数对齐失败排序，大的误差来自状态和标签。

    RLCDAlignBench 测量用强化学习做校准决策的 Jev，能否当作对齐失败的零样本检测器。

    Paper analysisRead analysis
  6. Analysis and theoryarXiv 2609.23215

    研究审计 Active Inference Agent 的 LLM 解释器失败模式

    审计 Active Inference Agent 上 LLM 解释器的监督叙述失败

    arXiv
    2609.23215
    Published
    Layer
    Application layer
    Setting
    LLM applications
    Evaluated models
    GPT-4o, Claude-3-Opus, Gemini
    Abstract三组触发下解释流畅但错误，所提缓解都未被评估。

    作者审计的是挂在智能体上的运行时解释器，而不是智能体本身。操作员读到的是信念与动作的自然语言叙述。作者要问哪些可复现触发会让这段叙述失败，以及失败痕迹是什么样。

    Paper analysisRead analysis
  7. Evaluation and benchmarksarXiv 2609.17320

    Emergence World：对长时程多智能体系统开展对抗压力测试

    提出 Emergence World，对长时程多智能体系统开展对抗压力测试

    arXiv
    2609.17320
    Published
    Layer
    Application layer
    Setting
    Multi-agent systems
    Evaluated models
    Claude Opus 4.8, DeepSeek v4 Pro, Gemini 3.5 Flash and others9

    Abstract作者通过长期平行世界实验指出模型对齐不具备可组合性，单模型群体会产生社会奉承、协同退缩及语言不透明等失效。

    Paper analysisRead analysis
You have reached the end