Translation in progress Some entries still include text in the original language.

Oct 12 · Monday

All papers

Found 24 papers

Filter4

Select any value within a category; different categories must all match. Counts include the other filters you have selected.Another 232papers have no tags yet and are not included in filtered results.

Defense type：Detection and filtering Attack surface / entry point：Tool responses Attack surface / entry point：Training data Attack surface / entry point：Weights and gradients Clear all

Another 232papers do not have category tags yet and are not included in filtered results.

Analysis and theoryarXiv 2610.13051Oct 9
Space beats statistics, retraining beats ranking: auditing training labels under label-only backdoors
Auditing training labels for label-only backdoors, comparing spaces and statistics, and judging by retraining
arXiv
2610.13051
Published
Oct 9
Layer
Training and data layer
Setting
Models and APIs
Evaluated models
ResNet-32
- DefensesDetection and filtering
- AttacksPoisoning and backdoors
AbstractLabel inspection must be done in a space that has not been fitted to these labels, and judged by retrained models rather than detection scores.
The authors ask: can a defender without trusted data decide which training labels to keep, and how much clean data this destroys, and what the final model accuracy is.
Paper analysisRead analysis
DefensesarXiv 2610.07657Oct 6
DEFER1 多智能体防御研究报告受控测试中的攻击成功率下降
实现 DEFER，以确定性检查优先拦截多智能体流水线的内容攻击
arXiv
2610.07657
Published
Oct 6
Layer
Application layer
Setting
Multi-agent systems
Evaluated models
Qwen3-235B-A22B-Instruct-2507, gpt-oss-120b, Llama-4-Scout-17B-16E-Instruct and others5
- DefensesPermissions and approval
- AttacksPrompt injection
- ComponentGuardrails and judges
AbstractDEFER 把确定性检查放在 judge 之前。
DEFER 用来测量多智能体授权流水线里，确定性规则在何处结束、LLM judge 从何处开始。
Paper analysisRead analysis
DefensesarXiv 2610.03073Oct 2
SecJev：为 System One 决策模型引入安全专业知识
提出 SecJev，用场景加权训练把决策模型适配为安全类型化判断
arXiv
2610.03073
Published
Oct 2
Layer
Training and data layer
Setting
Models and APIs
Evaluated models
SecJev-0.8B, SecJev-2B, SecJev-4B and others4
- DefensesDetection and filtering
- AttacksPrompt injection
- ComponentGuardrails and judges
AbstractSecJev 用共享打分器做安全决策，0.8B 的 task-macro 超过 Kev-9B。
SecJev 是 0.8B 到 9B 的安全决策模型族，作者称据其所知是首个面向安全的 Jev-like 家族。
Paper analysisRead analysis
Evaluation and benchmarksarXiv 2610.03448Oct 2
Study retests 15 prompt injection detectors: benchmark scores poorly predict agent deployment performance
重测提示注入检测器在 Agent 工具输出上的检出与任务阻断
arXiv
2610.03448
Published
Oct 2
Layer
Application layer
Setting
AI Agent
Evaluated models
Horizon-Labs, Wolf Defender, Prismor-1.5B and others15
- DefensesDetection and filtering
- AttacksPrompt injection
- ComponentGuardrails and judges
Abstract论文揭示公开基准无法反映智能体检测器表现，检测能力源于输入格式相似而非通用防御，建议基于工具输出与低误报评测。
Paper analysisRead analysis
DefensesarXiv 2610.01788Oct 1
SAGE：基于相似度从少量已验证样本中清洗中毒训练数据
提出 SAGE，用少量已核验样本按相似度清洗投毒训练数据
arXiv
2610.01788
Published
Oct 1
Layer
Training and data layer
Setting
Models and APIs
Evaluated models
ResNet-18, VGG-16
- DefensesDetection and filtering
- AttacksPoisoning and backdoors
Paper analysisRead analysis
DefensesarXiv 2609.34804Sep 28
物理认证联邦学习：为关键水务基础设施的协同异常检测提供安全保障
为协同异常检测提出物理准入门，在聚合前拦截不合规训练批次
arXiv
2609.34804
Published
Sep 28
Layer
Training and data layer
Setting
Models and APIs
Evaluated models
deep reconstruction autoencoder
- DefensesDetection and filtering
- AttacksPoisoning and backdoors
Abstract物理准入为联邦检测增加数据约束，但合规证明不等于无投毒或训练来源证明。
这是一项面向水基础设施联邦异常检测的物理准入防御研究。 作者针对隐藏训练遥测带来的投毒检查问题，结合不变量挖掘、聚合前过滤和零知识抽样证明。
Paper analysisRead analysis
Evaluation and benchmarksarXiv 2609.35886Sep 27
Agentic Commerce Bench：衡量会花钱的智能体的欺诈检测能力
构建支付欺诈基准 ACB，评测花钱智能体的欺诈检测
arXiv
2609.35886
Published
Sep 27
Layer
Application layer
Setting
AI Agent
Evaluated models
gordonguard, pattern judge
- DefensesDetection and filtering
- RiskDangerous agent actions
- ComponentGuardrails and judges
AbstractACB 把支付欺诈与智能体操纵分开测量，作者强调观察权限、误报预算和微支付复核成本。
ACB 是一套智能体支付欺诈基准与检测参考栈，目标是衡量钱是否被不当提取，而不仅是智能体是否接受了恶意指令。
Paper analysisRead analysis
DefensesarXiv 2609.33039Sep 27
TACIT: detecting agent trajectory harm from LLM internal states
提出 TACIT，从冻结内部状态检测智能体有害轨迹
arXiv
2609.33039
Published
Sep 27
Layer
Application layer
Setting
AI Agent
Evaluated models
Qwen3-4B, Llama-3.1-8B, Qwen3-4B-Instruct and others4
- DefensesDetection and filtering
- AttacksPrompt injection
- ComponentGuardrails and judges
Abstract提出基于内部表征的智能体轨迹安全检测方法 TACIT，揭示工具风险表征特性并在多项基准上提升检测表现与效率。
Paper analysisRead analysis
Evaluation and benchmarksarXiv 2609.29429Sep 24
Jev 被用于零样本检测十类对齐失败，中位 AUROC 达 0.886
提出 RLCDAlignBench，零样本检测多种对齐失败
arXiv
2609.29429
Published
Sep 24
Layer
Prompt layer
Setting
Models and APIs
Evaluated models
Jev (jev-1.13.0)
- DefensesDetection and filtering
- AttacksJailbreaks
- RiskMisalignment and value divergence
- ComponentGuardrails and judges
Abstract一次通用问题已能给多数对齐失败排序，大的误差来自状态和标签。
RLCDAlignBench 测量用强化学习做校准决策的 Jev，能否当作对齐失败的零样本检测器。
Paper analysisRead analysis
AttacksarXiv 2609.27124Sep 23
Fed-ADR：用恶意编排服务器协同客户端梯度操纵攻击联邦学习
提出 Fed-ADR，用编排服务器协同操纵梯度攻破联邦学习并检测恢复
arXiv
2609.27124
Published
Sep 23
Layer
Training and data layer
Setting
Models and APIs
Attacker
Gray-box
Evaluated models
CNN（MNIST：2 Conv + 3 FC）, CNN（Fashion-MNIST：6 Conv + 1 FC）, ResNet18（CIFAR-10）
- DefensesDetection and filtering
- AttacksPoisoning and backdoors
- TechniqueDefense-targeted
AbstractFed-ADR 用 gray-box 编排攻击绕过多种聚合防御，再用 Hessian 一致性检测和窗口内恢复把准确率拉回。
Fed-ADR 是一套面向联邦学习的攻击、检测与恢复框架：编排服务器改写合谋客户端的梯度，使参数服务器的现有防御把投毒更新当成良性，同时在发现后用历史梯度把全局模型原地修回来。
Paper analysisRead analysis
DefensesarXiv 2609.16098Sep 14
研究者提出面向工具集成 LLM Agent 的通用对抗攻击防御方法
提出 ATF 与 NTR，过滤或恢复工具集以阻止 Agent 调用攻击工具
arXiv
2609.16098
Published
Sep 14
Layer
Application layer
Setting
AI Agent
Evaluated models
Gemma2-9B, Qwen2-7B, LLaMA3-8B and others7
- DefensesPermissions and approval
- AttacksPrompt injection
Paper analysisRead analysis
DefensesarXiv 2609.14987Sep 14
ActGuard：面向 LLM Agent 间接提示注入的执行前动作审计框架
提出 ActGuard 执行前动作审计，定位并遮盖间接提示注入的恶意片段
arXiv
2609.14987
Published
Sep 14
Layer
Application layer
Setting
AI Agent
Evaluated models
GPT-4o-mini, Gemini-2.5-Flash, DeepSeek-V4-Flash
- DefensesMonitoring and auditing
- AttacksPrompt injection
Paper analysisRead analysis
DefensesarXiv 2609.10854Sep 10
MCPSEC：仅凭工具元数据检测 MCP 服务器间接提示注入漏洞
提出 MCPSEC，仅凭工具元数据无盒检测 MCP 间接提示注入漏洞
arXiv
2609.10854
Published
Sep 10
Layer
Application layer
Setting
AI Agent
- DefensesDetection and filtering
- AttacksPrompt injection
- ComponentMCP and skills
Paper analysisRead analysis
DefensesarXiv 2609.10707Sep 10
面向 AI-SOC 的神经符号防御框架：用 SIEM 解码器与 NeMo Guardrails 阻断日志投毒提示注入
提出神经符号纵深架构，阻断 AI-SOC 的日志投毒与间接提示注入
arXiv
2609.10707
Published
Sep 10
Layer
Application layer
Setting
LLM applications
Evaluated models
Gemma 3 (12B)
- DefensesDetection and filtering
- AttacksPrompt injection
- ComponentGuardrails and judges
Paper analysisRead analysis
DefensesarXiv 2609.07063Sep 7
VERITAS：抗投毒的本地差分隐私图学习协议
提出 VERITAS，用双边背书剪除本地隐私图学习中的投毒节点
arXiv
2609.07063
Published
Sep 7
Layer
Training and data layer
Setting
Models and APIs
Evaluated models
GCN, GraphSAGE, GAT
- DefensesDetection and filtering
- AttacksPoisoning and backdoors
AbstractVERITAS 用分级信任的双边背书剪除 LDP 图学习中的投毒节点，并恢复分类准确率。
VERITAS 是面向本地差分隐私图学习的投毒防御协议，按 trust-but-verify 在保持 ϵ-LDP 的同时剪除伪造节点。
Paper analysisRead analysis
DefensesarXiv 2609.06346Sep 6
面向后门攻击下持续学习的鲁棒动态扩展：净化与选择性恢复
提出持续学习下的净化与选择性恢复框架，抵御逐任务训练投毒后门
arXiv
2609.06346
Published
Sep 6
Layer
Training and data layer
Setting
Models and APIs
Evaluated models
ViT-B/16
- DefensesModel hardening
- AttacksPoisoning and backdoors
- ComponentVision
Abstract作者报告任务内净化与恢复可配合动态专家防御后门，但保证依赖分离条件。
这是一项面向持续图像分类的后门防御研究：模型只使用当前任务数据，同时需要保留过去知识并避免学习恶意监督。
Paper analysisRead analysis
DefensesarXiv 2609.27760Sep 4
FedMAST：用多轴结构痕迹检测并遏制联邦学习后门
提出 FedMAST，用多轴结构痕迹检测并遏制联邦学习后门
arXiv
2609.27760
Published
Sep 4
Layer
Training and data layer
Setting
Models and APIs
Evaluated models
Tiny ResNet-18
- DefensesDetection and filtering
- AttacksPoisoning and backdoors
Paper analysisRead analysis
DefensesarXiv 2609.02127Sep 2
论文提出带类型溯源与断言护栏，防止持久化 AI Agent 把不可信输入当作自身历史
提出类型化溯源与断言护栏，约束持久 Agent 释放自传断言
arXiv
2609.02127
Published
Sep 2
Layer
Application layer
Setting
AI Agent
- DefensesWatermarking and provenance
- AttacksPoisoning and backdoors
- ComponentMemory
Paper analysisRead analysis
DefensesarXiv 2608.02271Aug 3
Z-PEFT: Zero-shot backdoor detection for parameter-efficient fine-tuning based on canonical spectral features
Propose Z-PEFT, which detects PEFT backdoors in a zero-shot manner using per-head spectral features.
arXiv
2608.02271
Published
Aug 3
Layer
Training and data layer
Setting
Models and APIs
Evaluated models
Z-PEFT, Llama-2-7B, Llama-2-13B and others6
- DefensesDetection and filtering
- AttacksPoisoning and backdoors
- ComponentFine-tuning and open weights
Paper analysisRead analysis
DefensesarXiv 2607.25297Jul 28
MTGuard: Hybrid Analysis for Secure MCP Tool Calls in LLM Agents
Proposes MTGuard, which blocks unsafe tool calls by comparing MCP call declarations with execution traces.
arXiv
2607.25297
Published
Jul 28
Layer
Application layer
Setting
AI Agent
Evaluated models
DeepSeek-V4-Flash, DeepSeek-V4-Pro, GPT-5.6 Luna
- DefensesMonitoring and auditing
- AttacksPoisoning and backdoors
- ComponentMCP and skills
Paper analysisRead analysis

AI Safety Daily

Read the latest issueOne issue per day, updated as events develop

All papers

Attack type

Defense type

Impact

System type

Attack surface / entry point

Layer

System component

Space beats statistics, retraining beats ranking: auditing training labels under label-only backdoors

DEFER1 多智能体防御研究报告受控测试中的攻击成功率下降

SecJev：为 System One 决策模型引入安全专业知识

Study retests 15 prompt injection detectors: benchmark scores poorly predict agent deployment performance

SAGE：基于相似度从少量已验证样本中清洗中毒训练数据

物理认证联邦学习：为关键水务基础设施的协同异常检测提供安全保障

Agentic Commerce Bench：衡量会花钱的智能体的欺诈检测能力

TACIT: detecting agent trajectory harm from LLM internal states

Jev 被用于零样本检测十类对齐失败，中位 AUROC 达 0.886

Fed-ADR：用恶意编排服务器协同客户端梯度操纵攻击联邦学习

研究者提出面向工具集成 LLM Agent 的通用对抗攻击防御方法

ActGuard：面向 LLM Agent 间接提示注入的执行前动作审计框架

MCPSEC：仅凭工具元数据检测 MCP 服务器间接提示注入漏洞

面向 AI-SOC 的神经符号防御框架：用 SIEM 解码器与 NeMo Guardrails 阻断日志投毒提示注入

VERITAS：抗投毒的本地差分隐私图学习协议

面向后门攻击下持续学习的鲁棒动态扩展：净化与选择性恢复

FedMAST：用多轴结构痕迹检测并遏制联邦学习后门

论文提出带类型溯源与断言护栏，防止持久化 AI Agent 把不可信输入当作自身历史

Z-PEFT: Zero-shot backdoor detection for parameter-efficient fine-tuning based on canonical spectral features

MTGuard: Hybrid Analysis for Secure MCP Tool Calls in LLM Agents