Select any value within a category; different categories must all match. Counts include the other filters you have selected.Another 265papers have no tags yet and are not included in filtered results.

Defense type：Inference-time intervention Defense type：Permissions and approval Attack surface / entry point：User input Clear all

Another 265papers do not have category tags yet and are not included in filtered results.

DefensesarXiv 2610.10655Oct 8
Nullify：面向 LLM 遗忘的零空间激活引导免训练方法
提出零空间激活引导 Nullify，免训练擦除指定记忆并保持效用
arXiv
2610.10655
Published
Oct 8
Layer
Model layer
Setting
Models and APIs
Evaluated models
Llama-2-7B-chat-hf, Qwen3-8B
- DefensesInference-time intervention
- AttacksExtraction and theft
Paper analysisRead analysis
Evaluation and benchmarksarXiv 2610.10276Oct 7
PatchBench 提出激活补丁局部评测协议，揭示越狱修复的附带损伤
提出 PatchBench-Local 协议，评测激活补丁修复越狱的局部附带损伤
arXiv
2610.10276
Published
Oct 7
Layer
Model layer
Setting
Models and APIs
Evaluated models
Qwen2.5-3B-Instruct, Qwen2.5-14B-Instruct, gemma-3-4b-it and others8
- DefensesInference-time intervention
- AttacksJailbreaks
Abstract论文提出 PatchBench 与局部评估协议，揭示了激活补丁在全局能力无损下仍存局部良性退化。
Paper analysisRead analysis
DefensesarXiv 2610.09703Oct 7
研究揭示 Token-Pruning 对 VLM 安全性的影响并提出 SAP 缓解机制
提出 Safety-Aware Pruning，缓解视觉 token 剪枝放大的多模态越狱
arXiv
2610.09703
Published
Oct 7
Layer
Model layer
Setting
Models and APIs
Attacker
Black-box
Evaluated models
LLaVA-1.5-7B
- DefensesInference-time intervention
- AttacksJailbreaks
- ComponentVision
Abstract剪枝去掉背景 token 后注意力塌向恶意前景。
这篇工作评估视觉 token 剪枝如何改变 VLM 在多模态越狱下的行为，并给出推理时防御 SAP。
Paper analysisRead analysis
DefensesarXiv 2610.08678Oct 7
研究揭示投机解码的安全代价并提出 SecureSD 加固方法
测量有损投机解码的安全代价，并提出 SecureSD 收紧早期验证
arXiv
2610.08678
Published
Oct 7
Layer
Model layer
Setting
AI Agent
Attacker
Black-box
Evaluated models
Qwen3-8B, Qwen3-32B, Llama-3.1-8B-Instruct and others6
- DefensesInference-time intervention
- AttacksJailbreaks
Abstract有损推测解码的早期偏离更快抬高越狱与注入风险。
作者研究有损推测解码在换取速度时，是否会比效用更快地损害越狱与提示注入防护，并给出按位置校正的 SecureSD。
Paper analysisRead analysis
DefensesarXiv 2610.07657Oct 6
DEFER1 多智能体防御研究报告受控测试中的攻击成功率下降
实现 DEFER，以确定性检查优先拦截多智能体流水线的内容攻击
arXiv
2610.07657
Published
Oct 6
Layer
Application layer
Setting
Multi-agent systems
Evaluated models
Qwen3-235B-A22B-Instruct-2507, gpt-oss-120b, Llama-4-Scout-17B-16E-Instruct and others5
- DefensesPermissions and approval
- AttacksPrompt injection
- ComponentGuardrails and judges
AbstractDEFER 把确定性检查放在 judge 之前。
DEFER 用来测量多智能体授权流水线里，确定性规则在何处结束、LLM judge 从何处开始。
Paper analysisRead analysis
DefensesarXiv 2610.04504Oct 3
论文提出 VAL 框架：相同 ASR 的 LLM Agent 防御可能对应不同安全保证
提出 VAL 框架，并用确认门与参数沙箱约束智能体高风险工具调用
arXiv
2610.04504
Published
Oct 3
Layer
Application layer
Setting
AI Agent
Evaluated models
DeepSeek-chat, Meta Llama 3.1 8B, Kimi
- DefensesPermissions and approval
- AttacksPrompt injection
- ComponentPermissions and sandboxing
Paper analysisRead analysis
DefensesarXiv 2610.04470Oct 3
SENTINEL：通过意图感知的输入-输出匹配防御 LLM 越狱
提出生成时防御 SENTINEL，匹配输入输出以抽出越狱意图并停写
arXiv
2610.04470
Published
Oct 3
Layer
Model layer
Setting
Models and APIs
Attacker
White-box
Evaluated models
Llama2-7B, Llama3-8B, Mistral-7B-v0.2 and others6
- DefensesInference-time intervention
- AttacksJailbreaks
Paper analysisRead analysis
DefensesarXiv 2610.02432Oct 2
论文提出 LLM 输入扰动鲁棒性度量，并发布 ASA 攻击与 AttestMCP 防护
提出 ASA 与 AttestMCP，度量并降低 LLM 对输入序列扰动的敏感
arXiv
2610.02432
Published
Oct 2
Layer
Application layer
Setting
LLM applications, AI Agent
Attacker
Black-box
Evaluated models
Gemma-3-27B-Instruct, Gemma-3-4B-Instruct, Llama-3.2-3B-Instruct and others12
- DefensesDetection and filtering
- AttacksDetection evasion
- ComponentGuardrails and judges
Paper analysisRead analysis
DefensesarXiv 2609.36657Sep 29
Constitutional adapters：用推理期干预防御越狱与失准
提出 Constitutional adapters，蒸馏宪法行为以缓解越狱与失准
arXiv
2609.36657
Published
Sep 29
Layer
Model layer
Setting
Models and APIs
Evaluated models
Qwen3.5-4B, Llama-3.1-8B-Instruct, Gemma-4-E4B and others4
- DefensesInference-time intervention
- AttacksJailbreaks
- RiskMisalignment and value divergence
Abstract差分宪法适配器在长上下文和多轮上更稳，并可按 α 换取遵从。
Paper analysisRead analysis
DefensesarXiv 2609.34518Sep 28
SEAD 论文提出工具型 Agent 的状态视角攻击与防御方法 DART 与 SAGE
提出工具型 Agent 的自适应攻击 DART 与预执行防御 SAGE
arXiv
2609.34518
Published
Sep 28
Layer
Application layer
Setting
AI Agent
Evaluated models
GPT-5.6 Luna, GPT-5.6 Terra, Gemini 3.8 Flash and others5
- DefensesPermissions and approval
- AttacksJailbreaks
- ComponentPermissions and sandboxing
Abstract论文提出状态控制框架 SEAD、攻击 DART 与防御 SAGE，实验显示执行反馈与环境探测在攻防交互中具有关键作用。
Paper analysisRead analysis
DefensesarXiv 2609.34514Sep 28
CAM-Steer：面向大语言模型的多类别自适应安全引导框架
提出 CAM-Steer，推理时按多类别风险引导隐藏状态以降低有害回复
arXiv
2609.34514
Published
Sep 28
Layer
Model layer
Setting
Models and APIs
Evaluated models
Qwen3-8B, Llama-3.1-8B-Instruct, Gemma-2-9B-IT
- DefensesInference-time intervention
- AttacksJailbreaks
Paper analysisRead analysis
DefensesarXiv 2609.31056Sep 25
SCALPEL：用对比稀疏自编码器实现选择性表征层遗忘
提出 SCALPEL，用对比 SAE 在表征层选择性遗忘特定事实
arXiv
2609.31056
Published
Sep 25
Layer
Model layer
Setting
Models and APIs
Evaluated models
Qwen2.5-1.5B-Instruct, Llama-3.2-1B-Instruct, Gemma-2-2B-it
- DefensesInference-time intervention
- AttacksExtraction and theft
AbstractSCALPEL 以对比稀疏特征做窄目标表征遗忘，在 TOFU 上与优化基线相当且可检查。
SCALPEL 是不改基座权重的表征层遗忘方法，面向与保留数据重叠的窄目标。
Paper analysisRead analysis
DefensesarXiv 2609.29287Sep 24
AEGIS：用内部信号在中间层拦截大型音频语言模型越狱
提出 AEGIS，用中层内部信号选择性激活后层适配器拦截音频越狱
arXiv
2609.29287
Published
Sep 24
Layer
Model layer
Setting
Models and APIs
Attacker
White-box
Evaluated models
Qwen2-Audio-7B, VITA-1.5, Ultravox v0.5 and others6
- DefensesInference-time intervention
- AttacksJailbreaks
- ComponentAudio
Paper analysisRead analysis
DefensesarXiv 2609.28693Sep 24
skilder：以角色化技能包为工具型 LLM 智能体做访问控制
提出 Skilder，按角色渐进下发企业工具并确定性拦截越权调用
arXiv
2609.28693
Published
Sep 24
Layer
Application layer
Setting
AI Agent
Evaluated models
Claude Haiku 4.5, Qwen 3.5 122B, Gemma 4 31B and others6
- DefensesPermissions and approval
- AttacksJailbreaks
- ComponentMCP and skills
AbstractSkilder 用单 MCP 服务器按角色交付工具并硬拦截。
Skilder 把企业工具型智能体的能力按角色打包，经一个 MCP 服务器做渐进发现，使工具范围由服务器而不是提示词来执行。
Paper analysisRead analysis
DefensesarXiv 2609.24165Sep 21
APEXA 为同步辐射数据处理的 LLM 多智能体加装执行完整性护栏
提出 APEXA，在工具层拒绝无执行支撑的结果并拦截电机命令
arXiv
2609.24165
Published
Sep 21
Layer
Application layer
Setting
science agent
Evaluated models
GPT-5-mini, GPT-5.4, Claude Opus 4.7 and others4
- DefensesPermissions and approval
- AttacksPrompt injection
- RiskHallucination and fabrication
- ComponentPermissions and sandboxing
Abstract作者称执行是否发生要由工具层核对，而不能只靠提示词。
APEXA 是先进光子源上的数据还原框架，用工具层代码约束语言模型智能体的工具调用。
Paper analysisRead analysis
DefensesarXiv 2609.22573Sep 19
研究提出面向企业 MCP 的零信任授权与工具发现方案
提出企业 MCP 零信任授权与发现扩展，在架构上拒绝提示注入下的越权调用
arXiv
2609.22573
Published
Sep 19
Layer
Application layer
Setting
AI Agent
Evaluated models
gpt-5, claude-sonnet-4-6, claude-opus-4-7 and others6
- DefensesPermissions and approval
- AttacksPrompt injection
- ComponentMCP and skills
Abstract同一份按工具声明同时管 MCP 的发现、列表和调用，使注入不能扩大已有凭证的权限。
作者把零信任放在 MCP 工具调用边界：智能体即使被提示注入，也不能调用其凭证范围之外的工具。问题来自三点部署性质。调用意图会随不可信上下文改变。
Paper analysisRead analysis
Evaluation and benchmarksarXiv 2609.22076Sep 19
APort Vault released: evaluating AI agent payment authorization with 4,371 human-written attacks
构建 APort Vault 基准，对比支付智能体模型拒答与确定性授权
arXiv
2609.22076
Published
Sep 19
Layer
Application layer
Setting
AI Agent
Evaluated models
Claude Fable 5.1, Claude Sonnet 5, Claude Haiku 4.5 and others14
- DefensesPermissions and approval
- AttacksJailbreaks
- ComponentPermissions and sandboxing
Paper analysisRead analysis
DefensesarXiv 2609.16229Sep 15
ARIA：用稀疏自编码器实现测试时机器遗忘
提出 ARIA，在冻结权重上用 SAE 做推理时遗忘门控
arXiv
2609.16229
Published
Sep 15
Layer
Model layer
Setting
Models and APIs
Attacker
White-box
Evaluated models
DeepSeek-R1-Distill-Qwen-1.5B, Gemma-3-1B-it
- DefensesInference-time intervention
- AttacksExtraction and theft
- ComponentReasoning chains
Paper analysisRead analysis
DefensesarXiv 2609.16098Sep 14
研究者提出面向工具集成 LLM Agent 的通用对抗攻击防御方法
提出 ATF 与 NTR，过滤或恢复工具集以阻止 Agent 调用攻击工具
arXiv
2609.16098
Published
Sep 14
Layer
Application layer
Setting
AI Agent
Evaluated models
Gemma2-9B, Qwen2-7B, LLaMA3-8B and others7
- DefensesPermissions and approval
- AttacksPrompt injection
Paper analysisRead analysis
DefensesarXiv 2609.14258Sep 13
SPARK：在 KV 记忆层对齐表征以防御视觉语言模型越狱
提出 SPARK，在预填充阶段修复多模态 KV 记忆以防御视觉语言模型越狱
arXiv
2609.14258
Published
Sep 13
Layer
Model layer
Setting
Models and APIs
Attacker
White-box
Evaluated models
LLaVA-OneVision-7B, Chameleon-7B, Qwen2-VL-7B and others4
- DefensesInference-time intervention
- AttacksJailbreaks
- ComponentVision
Paper analysisRead analysis

AI Safety Daily

Read the latest issueOne issue per day, updated as events develop