Skip to content

Translation in progress Some entries still include text in the original language.

Oct 12 · Monday

All papers

Found 13 papers
Filter3

Attack type

Prompt injection4

Model risks

Deception and scheming4Hallucination and fabrication3

Defense type

Monitoring and auditing10

Impact

Harmful content12Unauthorized actions23Data and privacy leaks7Output manipulation6Oversight failure37

System type

AI Agent10coding agent4

Layer

Application layer10

System component

MCP and skills21Memory32RAG36Guardrails and judges41Monitors13Reasoning chains20Permissions and sandboxing19Fine-tuning and open weights24Vision57Audio14Video8Image generation15Embeddings10Multimodal88
Select any value within a category; different categories must all match. Counts include the other filters you have selected.Another 265papers have no tags yet and are not included in filtered results.
Impact：Data and privacy leaksImpact：Output manipulationSystem component：MonitorsClear all

Another 265papers do not have category tags yet and are not included in filtered results.

  2. DefensesarXiv 2610.07570

    ProbeGuard：按共识形成过程判断弃答，识别医疗问答中的一致错误

    提出 ProbeGuard，按共识形成过程对医疗问答做选择性弃答

    arXiv
    2610.07570
    Published
    Layer
    Application layer
    Setting
    LLM applications
    Evaluated models
    Qwen3-8B, Llama-3.1-8B-Instruct, HuatuoGPT-o1-8B
    AbstractProbeGuard 用共识形成过程做可认证弃权，并在全票层分开答对与答错的共识。

    ProbeGuard 是给多轮共识医学问答用的认证弃权框架：基板照原样作答，弃权只看共识是怎么形成的。

    Paper analysisRead analysis
  3. InterpretabilityarXiv 2610.06576

    研究：智能体欺骗行为在外部显现前已可从内部表征预测

    提出基于决策前隐藏状态的检测与引导，预测并抑制智能体欺骗

    arXiv
    2610.06576
    Published
    Layer
    Model layer
    Setting
    AI Agent
    Evaluated models
    Qwen3-14B

    Abstract论文展示了智能体自发欺骗可在行为显现前由内部表征预测，并通过激活引导证实了表征的行为可操作性。

    Paper analysisRead analysis
  5. Risky behaviorarXiv 2609.32701

    研究显示前沿模型智能体在测试时自行形成隐蔽信道

    展示智能体在禁止泄露与独立监视下自发建立隐蔽信道传递机密

    arXiv
    2609.32701
    Published
    Layer
    Application layer
    Setting
    Multi-agent systems
    Evaluated models
    GPT-5.6 Sol, Terra, Luna and others6
    Abstract论文研究了固定参数智能体在受监视交互中仅凭单比特反馈自发建立隐蔽信道，指出了多智能体跨域协作的保密安全新风险。

    论文研究了固定参数与提示词的智能体在受审计交互中自发形成隐蔽信道并泄露机密的过程。

    Paper analysisRead analysis
  6. AttacksarXiv 2609.27542

    研究者用控制 token 注入删除 gpt-oss-20b 推理链并绕过思维链监控

    提出控制标记注入，清空工具 Agent 的思维链以绕过推理监控

    arXiv
    2609.27542
    Published
    Layer
    Application layer
    Setting
    AI Agent
    Evaluated models
    openai/gpt-oss-20b, google/gemma-4-26B-A4B-it, deepseek-ai/DeepSeek-R1-Distill-Qwen-7B and others4

    Abstract论文阐明控制标记注入可抑制 CoT 使监控失效并促成拒绝绕过，且工具执行受解析器宽容度影响。

    Paper analysisRead analysis
  7. DefensesarXiv 2609.19587

    红队测试 Auto Mode：用注入与多上下文攻击绕过编码 Agent 阻断监控器

    提出 Auto Mode ++，加固编码 Agent 阻断监视器

    arXiv
    2609.19587
    Published
    Layer
    Application layer
    Setting
    coding agent
    Evaluated models
    Opus 5, Opus 4.8, Opus 4.7 and others8

    Abstract系统评估生产阻断监视器在面对持续恶意智能体时的表现，提出加固防御并指明多上下文防御挑战。

    Paper analysisRead analysis
  8. DefensesarXiv 2609.04159

    Sentinel-RL：将拓扑推理从 LLM 智能体中卸载到安全运营中心

    提出 Sentinel-RL，将拓扑处置从 LLM 卸载到受约束图策略

    arXiv
    2609.04159
    Published
    Layer
    Application layer
    Setting
    LLM applications
    Evaluated models
    HetGAT, PPO
    AbstractSentinel-RL 用图编码器与 PPO 承担拓扑决策，LLM 负责叙述与门控，并在 LANL 上报告检测与时延。

    Sentinel-RL 是面向 SOC 的神经符号架构：拓扑决策离开 LLM，改由认证图上的 HetGAT 与 PPO 完成。

    Paper analysisRead analysis
  9. AttacksarXiv 2609.01023

    Akrasia：针对推理型代码 LLM 的隐蔽后门攻击

    提出隐蔽后门攻击 AKRASIA，在推理代码模型提示中植入触发器并伪装思维链

    arXiv
    2609.01023
    Published
    Layer
    Prompt layer
    Setting
    coding agent
    Evaluated models
    Claude-Sonnet-5, GPT-5.5, Gemini-3.5-flash and others7

    Abstract论文针对推理代码大模型提出了隐蔽推断期后门攻击 AKRASIA，揭示了模型思维链可被利用进行欺骗性伪装的安全隐患。

    Paper analysisRead analysis
  12. DefensesarXiv 2605.17380

    Uber proposes ADR enterprise-level agent detection system, deployed on 7,200 hosts for ten months

    提出企业级检测系统 ADR，识别编程 Agent 的提示注入与恶意 MCP

    arXiv
    2605.17380
    Published
    Layer
    Application layer
    Setting
    coding agent

    Abstract提出了端点因果遥测、两级在线分流与离线红队闭环的 ADR 系统，并在生产环境中验证了有效性。

    Paper analysisRead analysis
You have reached the end