Skip to content

Translation in progress Some entries still include text in the original language.

Oct 12 · Monday

All papers

Found 27 papers

Another 233papers do not have category tags yet and are not included in filtered results.

  1. DefensesarXiv 2610.07657

    DEFER1 多智能体防御研究报告受控测试中的攻击成功率下降

    实现 DEFER,以确定性检查优先拦截多智能体流水线的内容攻击

    Published
    Evaluated models
    Qwen3-235B-A22B-Instruct-2507, gpt-oss-120b, Llama-4-Scout-17B-16E-Instruct and others5
    AbstractDEFER 把确定性检查放在 judge 之前。

    DEFER 用来测量多智能体授权流水线里,确定性规则在何处结束、LLM judge 从何处开始。

    Paper analysisRead analysis
  2. AgentSpy: Observing AI agent behavior at the system call layer and detecting skill injection attacks

    提出 AgentSpy,在系统调用层观测 Agent 行为并检测技能注入

    Published
    Evaluated models
    gpt-5.6-terra, deepseek-v4-flash, glm-5.3-flash and others4
    Abstract提出了系统级智能体监控框架 AgentSpy,揭示出通过测试背后的非预期行为与注入风险。

    本研究提出了面向 AI 智能体的系统级外部监控与行为分析框架 AgentSpy。

    Paper analysisRead analysis
  3. DefensesarXiv 2610.04412

    论文研究 LLM 数字孪生参与增强民主时的提示注入脆弱性

    提出检测、结构化与 GSPO 流程,降低共识生成的提示注入错位

    Published
    Evaluated models
    LLaMA-2 7B, LLaMA-3 8B, GPT 3.5 Turbo and others14
    Abstract三章依次做个体偏好预测、政党知识图谱审议,以及共识生成对提示注入的脆弱性与一条防御流程。

    这是一篇把 LLM 数字孪生放进增强民主的博士论文,分个体表示、政党聚合和共识生成的提示注入三章。

    Paper analysisRead analysis
  4. DefensesarXiv 2610.02432

    论文提出 LLM 输入扰动鲁棒性度量,并发布 ASA 攻击与 AttestMCP 防护

    提出 ASA 与 AttestMCP,度量并降低 LLM 对输入序列扰动的敏感

    Published
    Attacker
    Black-box
    Evaluated models
    Gemma-3-27B-Instruct, Gemma-3-4B-Instruct, Llama-3.2-3B-Instruct and others12
    Paper analysisRead analysis
  5. Study retests 15 prompt injection detectors: benchmark scores poorly predict agent deployment performance

    重测提示注入检测器在 Agent 工具输出上的检出与任务阻断

    Published
    Setting
    AI Agent
    Evaluated models
    Horizon-Labs, Wolf Defender, Prismor-1.5B and others15

    Abstract论文揭示公开基准无法反映智能体检测器表现,检测能力源于输入格式相似而非通用防御,建议基于工具输出与低误报评测。

    Paper analysisRead analysis
  6. DefensesarXiv 2609.33039

    TACIT: detecting agent trajectory harm from LLM internal states

    提出 TACIT,从冻结内部状态检测智能体有害轨迹

    Published
    Setting
    AI Agent
    Evaluated models
    Qwen3-4B, Llama-3.1-8B, Qwen3-4B-Instruct and others4

    Abstract提出基于内部表征的智能体轨迹安全检测方法 TACIT,揭示工具风险表征特性并在多项基准上提升检测表现与效率。

    Paper analysisRead analysis
  7. DefensesarXiv 2609.30657

    研究者提出面向邮件 Agent 的攻击链建模提示注入检测框架

    提出面向邮件 Agent 的攻击链提示注入检测框架

    Published
    Setting
    AI Agent
    Evaluated models
    Proposed framework
    Abstract攻击链与动作一致性融合改善了严格检测的平均 F1,但迁移、误报和攻击召回仍需分别看。

    这是一项邮件智能体提示注入防御的离线建模与评测研究:作者把攻击文本是否恶意、攻击是否推进到工具操作、最终参数是否达标分开处理。

    Paper analysisRead analysis
  8. AttacksarXiv 2609.22510

    特拉维夫大学提出爆炸性提示词:条件触发的间接提示注入可绕过九款生产 Agent

    提出条件触发的爆炸提示词,并设计摄入期检测器 DeFuse

    Published
    Setting
    AI Agent
    Evaluated models
    Llama-3.1-8B-Instruct, Llama-3.1-70B-Instruct, Qwen2.5-32B-Instruct and others15
    Abstract论文揭示了条件触发使提示注入绕过防御并在触发时执行工具,提出轻量检测器并在摄入期有效防范。

    论文针对大语言模型智能体面临的间接提示注入威胁,研究了利用条件句式实现时间分离的爆炸提示词。

    Paper analysisRead analysis
  9. AttacksarXiv 2607.06595

    When Agents Remember Too Much: Memory Poisoning Attacks against Large Language Model Agents

    Proposed GhostWriter memory poisoning, which writes into the agent's long-term memory via email and calendar and activates across sessions

    Published
    Setting
    AI Agent
    Evaluated models
    GPT-5.4-mini, DeepSeek-V4-Flash, Gemini-2.5-Flash and others4
    Paper analysisRead analysis
  10. DefensesarXiv 2606.08234

    SciTrace:面向科学发现智能体的轨迹感知安全推理框架

    提出 SciTrace,为科学发现智能体加入跨阶段安全推理与工具轨迹核验

    Published
    Evaluated models
    Llama-3.1-70B-Instruct, Qwen2.5-72B-Instruct, DeepSeek-V3 and others4
    AbstractSciTrace 把安全推理织入科学智能体各阶段,在 SciSafetyBench 上提高安全指标并保持输出质量。

    SciTrace 是加在科学发现智能体流水线上的安全框架,不是再在各阶段出口放一个独立过滤器。

    Paper analysisRead analysis
  11. DefensesarXiv 2605.17380

    Uber proposes ADR enterprise-level agent detection system, deployed on 7,200 hosts for ten months

    提出企业级检测系统 ADR,识别编程 Agent 的提示注入与恶意 MCP

    Published

    Abstract提出了端点因果遥测、两级在线分流与离线红队闭环的 ADR 系统,并在生产环境中验证了有效性。

    Paper analysisRead analysis
  12. DefensesarXiv 2603.14707

    Visual Confusion Agents: Exploiting and Defending Against Perception Failures in Computer-Use Agents

    Proposes out-of-process dual-channel comparison classification to intercept erroneous clicks by computer-use agents

    Published
    Evaluated models
    multi-modal-embed-small
    AbstractPerception errors can be exploited by swapping screen pixels.

    The authors frame CUA's perception failure as a security vulnerability, visual confused deputy: the agent authorizes click(x,y) based on a misread screen, and the actual landing point differs from the element it believes it is clicking.

    Paper analysisRead analysis