Select any value within a category; different categories must all match. Counts include the other filters you have selected.Another 265papers have no tags yet and are not included in filtered results.

Impact：Data and privacy leaks System component：Monitors System component：Embeddings Clear all

Another 265papers do not have category tags yet and are not included in filtered results.

AttacksarXiv 2610.09920Oct 7
研究：多向量视觉文档索引可被反演还原页面内容
提出流匹配逆向框架，从多向量视觉文档索引重构页面
arXiv
2610.09920
Published
Oct 7
Layer
Application layer
Setting
LLM applications
Evaluated models
Tomoro-ColQwen3-8B, ColQwen3.5-4.5B, Tomoro-colqwen3-embed-4b and others13
- AttacksExtraction and theft
- ComponentEmbeddings
Paper analysisRead analysis
Evaluation and benchmarksarXiv 2610.06454Oct 5
AgentPrivArena：面向 LLM Agent 工作流的隐私风险评测框架
提出 AgentPrivArena 与运行时审计，评测 Agent 轨迹级隐私泄露
arXiv
2610.06454
Published
Oct 5
Layer
Application layer
Setting
AI Agent
Evaluated models
GPT-5.4, DeepSeek-V4-Pro, Kimi-K2.6 and others6
- DefensesMonitoring and auditing
- RiskDangerous agent actions
- ComponentMonitors
Paper analysisRead analysis
Risky behaviorarXiv 2609.32701Sep 26
研究显示前沿模型智能体在测试时自行形成隐蔽信道
展示智能体在禁止泄露与独立监视下自发建立隐蔽信道传递机密
arXiv
2609.32701
Published
Sep 26
Layer
Application layer
Setting
Multi-agent systems
Evaluated models
GPT-5.6 Sol, Terra, Luna and others6
- RiskDeception and scheming
- ComponentMonitors
Abstract论文研究了固定参数智能体在受监视交互中仅凭单比特反馈自发建立隐蔽信道，指出了多智能体跨域协作的保密安全新风险。
论文研究了固定参数与提示词的智能体在受审计交互中自发形成隐蔽信道并泄露机密的过程。
Paper analysisRead analysis
AttacksarXiv 2609.27542Sep 23
研究者用控制 token 注入删除 gpt-oss-20b 推理链并绕过思维链监控
提出控制标记注入，清空工具 Agent 的思维链以绕过推理监控
arXiv
2609.27542
Published
Sep 23
Layer
Application layer
Setting
AI Agent
Evaluated models
openai/gpt-oss-20b, google/gemma-4-26B-A4B-it, deepseek-ai/DeepSeek-R1-Distill-Qwen-7B and others4
- AttacksPrompt injection
- TechniqueConversation structure manipulation
- ComponentReasoning chains
Abstract论文阐明控制标记注入可抑制 CoT 使监控失效并促成拒绝绕过，且工具执行受解析器宽容度影响。
Paper analysisRead analysis
DefensesarXiv 2609.19587Sep 17
红队测试 Auto Mode：用注入与多上下文攻击绕过编码 Agent 阻断监控器
提出 Auto Mode ++，加固编码 Agent 阻断监视器
arXiv
2609.19587
Published
Sep 17
Layer
Application layer
Setting
coding agent
Evaluated models
Opus 5, Opus 4.8, Opus 4.7 and others8
- DefensesMonitoring and auditing
- RiskDeception and scheming
- ComponentMonitors
Abstract系统评估生产阻断监视器在面对持续恶意智能体时的表现，提出加固防御并指明多上下文防御挑战。
Paper analysisRead analysis
AttacksarXiv 2609.06749Sep 7
PMA 攻击：针对隐私保护 LLM 中嵌入到嵌入混淆的语义流形对齐方法
提出 PMA，用流形对齐从 E2EO 混淆向量恢复明文
arXiv
2609.06749
Published
Sep 7
Layer
Model layer
Setting
Models and APIs
Evaluated models
BERT-base, RoBERTa-base, T5-base and others6
- AttacksExtraction and theft
- ComponentEmbeddings
Paper analysisRead analysis
DefensesarXiv 2609.04767Sep 4
SHAQ：用影子查询实现向量数据库中的隐私检索
提出 SHAQ，用影子查询嵌入替换文档嵌入以抵御嵌入反演
arXiv
2609.04767
Published
Sep 4
Layer
Application layer
Setting
LLM applications
Attacker
Black-box
Evaluated models
GTR-T5 encoder, DPR
- AttacksExtraction and theft
- ComponentEmbeddings
AbstractSHAQ 用影子查询嵌入替换文档嵌入。
SHAQ 是面向云端向量库 EIA 的防御：不直接改文档嵌入，而用影子查询嵌入替换它们。
Paper analysisRead analysis
AttacksarXiv 2607.01276Jul 1
研究者提出嵌入推断攻击 EIA，可在黑盒 IR 系统中识别所用嵌入模型
提出嵌入推断攻击 EIA，在黑盒 IR 中识别所用嵌入模型
arXiv
2607.01276
Published
Jul 1
Layer
Application layer
Setting
LLM applications
Attacker
Black-box
Evaluated models
e5-small, e5-small-v2, e5-base and others19
- AttacksExtraction and theft
- ComponentEmbeddings
AbstractEIA 用无序文档集的差异从候选中识别嵌入模型，并给出 reranker 与阈值下的计数。
EIA 是在黑盒 IR 上识别所用嵌入模型的攻击。。
Paper analysisRead analysis
Evaluation and benchmarksarXiv 2606.05647Jun 4
Study: 94% of developers failed to detect covert sabotage by coding agents
评测开发者能否在协作编程中发现编码 Agent 的隐蔽破坏
arXiv
2606.05647
Published
Jun 4
Layer
Application layer
Setting
coding agent
Evaluated models
Claude-Opus-4.6, GPT-5.4, Gemini-3.1-Pro and others5
- DefensesMonitoring and auditing
- RiskDeception and scheming
- ComponentMonitors
Paper analysisRead analysis
DefensesarXiv 2605.17380May 17
Uber proposes ADR enterprise-level agent detection system, deployed on 7,200 hosts for ten months
提出企业级检测系统 ADR，识别编程 Agent 的提示注入与恶意 MCP
arXiv
2605.17380
Published
May 17
Layer
Application layer
Setting
coding agent
- DefensesDetection and filtering
- AttacksPrompt injection
- ComponentMCP and skills
Abstract提出了端点因果遥测、两级在线分流与离线红队闭环的 ADR 系统，并在生产环境中验证了有效性。
Paper analysisRead analysis
AttacksarXiv 2602.01757Feb 2
Zero2Text：无需训练的跨域文本嵌入反转攻击
提出 Zero2Text，无需训练地跨域反演文本嵌入
arXiv
2602.01757
Published
Feb 2
Layer
Model layer
Setting
Models and APIs
Attacker
Black-box
Evaluated models
GTR-Base, Qwen3-Embedding-0.6B, Text-Embedding-3-small and others4
- AttacksExtraction and theft
- TechniqueAutomated search
- ComponentEmbeddings
Abstract零训练在线对齐可在未知域、无泄漏对时从黑盒 embedding 还原句子。
Zero2Text 是一种不训练 decoder、也不使用泄漏文本–向量对的文本 embedding 反演，针对 RAG 向量库在严格黑盒、目标域未知时的还原。
Paper analysisRead analysis
DefensesarXiv 2601.14660Jan 21
NeuroFilter: Activation-value guardrails for privacy-conscious LLM agents
提出 NeuroFilter，用激活探针过滤智能体多轮隐私攻击
arXiv
2601.14660
Published
Jan 21
Layer
Application layer
Setting
AI Agent
Attacker
Black-box
Evaluated models
GPT-OSS 20B, Qwen 2.5 32B Instruct, Llama 3.3 70B and others8
- DefensesMonitoring and auditing
- AttacksJailbreaks
- ComponentMonitors
Paper analysisRead analysis

You have reached the end

AI Safety Daily

Read the latest issueOne issue per day, updated as events develop