Skip to content

Translation in progress Some entries still include text in the original language.

Oct 12 · Monday

All papers

Found 18 papers

Another 240papers do not have category tags yet and are not included in filtered results.

  1. AttacksarXiv 2610.04589

    StegoMemory red team testing: agent persistent memory can be used as a cross-session covert channel

    提出 StegoMemory,评测智能体持久记忆作为跨会话隐写信道

    Published
    Setting
    AI Agent
    Evaluated models
    Llama 3.1 405B, Claude 3.5 Sonnet, GPT-4o and others13

    Abstract研究揭示智能体持久记忆可作为隐蔽信道跨会话传输机密,写入持久化是主要防御瓶颈,呼吁建立记忆完整性防御。

    Paper analysisRead analysis
  2. AttacksarXiv 2609.27542

    Researchers use control token injection to delete gpt-oss-20b's reasoning chain and bypass chain-of-thought monitoring

    提出控制标记注入,清空工具 Agent 的思维链以绕过推理监控

    Published
    Setting
    AI Agent
    Evaluated models
    openai/gpt-oss-20b, google/gemma-4-26B-A4B-it, deepseek-ai/DeepSeek-R1-Distill-Qwen-7B and others4

    Abstract论文阐明控制标记注入可抑制 CoT 使监控失效并促成拒绝绕过,且工具执行受解析器宽容度影响。

    Paper analysisRead analysis
  3. AttacksarXiv 2609.15989

    Researchers propose plan injection attack that can bypass chain-of-thought monitoring

    提出 plan injection 攻击,植入良性伪装计划以绕过思维链监视器

    Published
    Attacker
    Gray-box
    Evaluated models
    Qwen2.5-Coder-7B-Instruct, Qwen3-8B, DeepSeek-R1-0528 and others6

    Abstract论文指出模型会将外部上下文中的伪装计划改写为自身推理,使思维链监视器失效甚至反向合理化恶意行为。

    Paper analysisRead analysis
  4. AttacksarXiv 2609.09553

    研究:任意密文攻击前沿大模型无需微调即可越狱

    提出任意字母置换密码越狱,无需微调即可诱导有害输出

    Published
    Attacker
    Black-box
    Evaluated models
    Claude Sonnet 4, Claude Sonnet 4.5, Gemini 3 Flash (preview) and others7

    Abstract前沿大模型无需微调即可通过提示词学会字母置换密码,进而绕过分类器与对齐,作者呼吁关注能力提升带来的安全风险。

    Paper analysisRead analysis
  5. 论文揭示大推理模型的对齐崩溃并提出 Reasoning Trap 越狱范式

    揭示推理加深引发的对齐坍塌,用 Reasoning Trap 放大越狱

    Published
    Evaluated models
    Qwen3-8B, Qwen3-14B, Llama2-7B and others8
    Abstract更深推理提升题目准确率,同时提高扰动下的相对损失。

    作者研究扩展推理是否以对齐稳健性为代价,提出 ALR、RT 与 RRA。。

    Paper analysisRead analysis
  6. AttacksarXiv 2609.01023

    Akrasia:针对推理型代码 LLM 的隐蔽后门攻击

    提出隐蔽后门攻击 AKRASIA,在推理代码模型提示中植入触发器并伪装思维链

    Published
    Evaluated models
    Claude-Sonnet-5, GPT-5.5, Gemini-3.5-flash and others7

    Abstract论文针对推理代码大模型提出了隐蔽推断期后门攻击 AKRASIA,揭示了模型思维链可被利用进行欺骗性伪装的安全隐患。

    Paper analysisRead analysis
  7. AttacksarXiv 2608.09867

    Researchers steal proprietary LLM inference chains via cross-model compatibility of encrypted inference blocks

    利用加密思维块的跨模型重放,诱导弱模型逐字转写专有推理链

    Published
    Attacker
    Black-box
    Evaluated models
    Claude Opus 4.8, Claude Sonnet 4.6, Claude Haiku 4.5 and others13

    Abstract论文揭示了客户端加密思维块跨模型互换漏洞,提出了低成本提取方法并给出防御方案。

    Paper analysisRead analysis
  8. AttacksarXiv 2605.13338

    研究者提出层级遗传算法黑盒攻击,诱导推理模型过度思考

    提出层级遗传算法 HGA,扰动题目逻辑结构诱发推理模型过度思考

    Published
    Attacker
    Black-box
    Evaluated models
    DeepSeek-R1 (671B), Qwen3-Thinking, GPT-o3 and others5

    AbstractHGA 在黑盒推理模型上用逻辑扰动拉长输出,作者称可从小代理迁移,查询成本是其局限。

    Paper analysisRead analysis
  9. AttacksarXiv 2604.05549

    Stop obsessing over prompts: reasoning hijacking and constraint tightening for red-teaming LLM agents

    提出 JailAgent,不改用户提示,经推理劫持与记忆投毒操纵 Agent 动作

    Published
    Setting
    AI Agent
    Evaluated models
    GPT-3.5-turbo, GPT-4o, GPT-5 and others7
    AbstractJailAgent 不改提示词,用三阶段操纵推理与检索。

    JailAgent 是不修改用户原始提示词的 LLM 智能体红队框架。

    Paper analysisRead analysis
  10. AttacksarXiv 2603.17239

    LAAF: A Systematic Red-Teaming Method and Automated Attack Framework for LPCI Vulnerabilities in Agentic LLM Systems

    Proposes LAAF, which automatically attacks LPCI vulnerabilities in agent systems in stages

    Published
    Setting
    AI Agent
    Evaluated models
    gemini-2.0-flash-001, claude-3-haiku-20240307, meta-llama/llama-3.1-70b-instruct and others5
    AbstractLAAF does LPCI red teaming with taxonomy plus stage seeding.

    The authors state that LAAF is an automated red-teaming framework built specifically for LPCI in agentic LLMs. The issue to address is that encoded, delayed, and conditionally triggered payloads can persist in memory or RAG and re-enter across sessions, whereas Garak and PyRIT do not use the previous round's breakthrough results to seed the next stage across the six stages.

    Paper analysisRead analysis
  11. AttacksarXiv 2603.10091

    Multi-Stream Perturbation Attack: Breaking the Safety Alignment of Reasoning LLMs through Concurrent Task Interference

    提出多流扰动攻击,交织有害与良性任务绕过思考型 LLM 安全对齐

    Published
    Evaluated models
    Qwen3 1.7B, Qwen3 4B, Qwen3 8B and others11
    Abstract多流扰动用任务交织测试 thinking 模式,作者称它同时冲击内容安全与推理稳定性。

    多流扰动攻击把有害任务与良性任务织进同一提示词,测试 thinking 模式的内容安全与推理稳定性。作者认为,交织多任务会拉长思考,使安全检测面对被打散的有害意图,并可能把推理用于合理化,或陷入崩溃与重复。方法不访问梯度。

    Paper analysisRead analysis
  12. AttacksarXiv 2602.18514

    招聘中的特洛伊木马:标准模型与推理模型间接提示注入的红队测试案例研究

    用简历中的不可见指令做间接提示注入,操纵招聘推荐

    Published
    Evaluated models
    Qwen 3 30B A3B Instruct 2507, Qwen 3 30B A3B Thinking 2507

    Abstract作者称推理在简单注入下会帮攻击圆谎,在不合逻辑的复杂注入下又会把欺骗漏出来。

    Paper analysisRead analysis
  13. AttacksarXiv 2507.10457

    论文提出 LPCI:针对 Agent 逻辑层与持久记忆的提示控制注入攻击

    提出 LPCI,把延迟条件载荷写入记忆与检索库以跨会话触发

    Published
    Setting
    AI Agent
    Evaluated models
    ChatGPT, Claude, LLaMA3 and others8
    Abstract作者定义 LPCI。

    作者把LPCI定义为针对智能体逻辑执行、记忆留存和工具集成的跨阶段漏洞类,而不是单次输入上的提示改写。

    Paper analysisRead analysis
You have reached the end