Translation in progress Some entries still include text in the original language.

Oct 12 · Monday

All papers

Found 10 papers

Filter3

Attack type

Jailbreaks15 Poisoning and backdoors3 Extraction and theft5 Detection evasion7 Malicious use7

Defense type

Watermarking and provenance3

Impact

Output manipulation8

System type

Models and APIs9

Attack surface / entry point

Images, audio and video7 Weights and gradients4 Distribution channels3

Layer

Model layer6

System component

MCP and skills43 Memory38 RAG22 Guardrails and judges33 Monitors11 Reasoning chains7 Permissions and sandboxing12 Fine-tuning and open weights30 Vision17 Audio4 Video4 Image generation10 Embeddings4 Multimodal33

Select any value within a category; different categories must all match. Counts include the other filters you have selected.Another 265papers have no tags yet and are not included in filtered results.

Attack type：Poisoning and backdoors Attack type：Detection evasion System component：Image generation Clear all

Another 265papers do not have category tags yet and are not included in filtered results.

Evaluation and benchmarksarXiv 2610.07939Oct 6
CCDF dataset: Grok Imagine, Veo 3.1, Sora 2 forge surveillance footage, ten deepfake detectors basically cannot recognize it
提出监控深伪基准 CCDF，在统一编码后评测检测器对伪造犯罪事故录像的识别
arXiv
2610.07939
Published
Oct 6
Layer
Prompt layer
Setting
Models and APIs
Evaluated models
C2P-CLIP, ForgeLens, D3-Im and others10
- DefensesDetection and filtering
- AttacksDetection evasion
- ComponentGuardrails and judges
Abstract提出消除格式捷径的监控深度伪造基准 CCDF，揭示现有检测器难以识别商用生成视频。
Paper analysisRead analysis
DefensesarXiv 2610.05870Oct 5
MBZUAI 提出可校准的真实图像认证方法
提出校准重合成方法，以生成器反演保真度认证真实图像并防御对抗扰动
arXiv
2610.05870
Published
Oct 5
Layer
Application layer
Setting
LLM applications
Attacker
White-box
- DefensesDetection and filtering
- AttacksDetection evasion
- ComponentImage generation
Abstract论文提出基于反演保真度与阈值校准的健全认证框架，在对抗扰动下维持错误率界限，并指出真实内容可认证性随生成器演进而萎缩。
Paper analysisRead analysis
AttacksarXiv 2610.05453Oct 5
研究者提出 Privacy-Leaking Watermarks，可在本地多模态模型中泄露对话隐私
提出 PLW，用微调把先前对话敏感触发编码进后续生成图像
arXiv
2610.05453
Published
Oct 5
Layer
Training and data layer
Setting
Models and APIs
Evaluated models
OmniGen2, BAGEL-7B
- AttacksPoisoning and backdoors
- TechniqueDormant triggers
- ComponentFine-tuning and open weights
AbstractPLW 把先前对话线索写成后续图像中的隐水印，检出随触发、模型和间隔变化。
Paper analysisRead analysis
DefensesarXiv 2610.00780Oct 1
TAILOR：面向图像水印的组合方案定制框架
提出 TAILOR，按请求组合图像水印以满足抗攻击与画质延迟规格
arXiv
2610.00780
Published
Oct 1
Layer
Model layer
Setting
Models and APIs
- DefensesWatermarking and provenance
- AttacksDetection evasion
- ComponentImage generation
Paper analysisRead analysis
DefensesarXiv 2609.39548Sep 30
NDDL：用正常扩散动力学为文生图模型做后门防御
提出 NDDL，用良性扩散轨迹检测文生图后门提示并定位触发 token
arXiv
2609.39548
Published
Sep 30
Layer
Model layer
Setting
Models and APIs
Evaluated models
Stable Diffusion v1.5, Stable Diffusion XL, Stable Diffusion v3.5 and others4
- DefensesMonitoring and auditing
- AttacksPoisoning and backdoors
- ComponentImage generation
AbstractNDDL 从良性扩散轨迹学习正常转移，用动态不一致检测后门并定位触发 token。
NDDL 是面向文生图扩散模型的后门防御：防御者只有白盒模型访问和良性提示词，没有后门先验，需要区分后门提示词并找出触发 token。
Paper analysisRead analysis
AttacksarXiv 2609.39047Sep 30
BadAction：通过动作引导触发器对交互式视频生成模型实施后门攻击
提出 BadAction，通过动作触发器给交互式视频生成植入后门
arXiv
2609.39047
Published
Sep 30
Layer
Training and data layer
Setting
Models and APIs
Evaluated models
Astra (Wan2.1-T2V-1.3B)
- AttacksPoisoning and backdoors
- TechniqueDormant triggers
- ComponentFine-tuning and open weights
Paper analysisRead analysis
DefensesarXiv 2609.34744Sep 28
现代图像后置水印信道的优化与安全：SNW 方案
提出带密钥的 SNW，抵御事后图像水印的身份伪造
arXiv
2609.34744
Published
Sep 28
Layer
Model layer
Setting
Models and APIs
Evaluated models
SNW
- DefensesWatermarking and provenance
- AttacksDetection evasion
- ComponentImage generation
AbstractSNW 用密钥与满秩各向同性投影提高事后水印的 Shannon 容量，并对 PCA 完全安全。
Gesny 与 Giboulot 针对生成内容追溯所依赖的多比特事后图像水印，批评端到端 DNN 方案既无容量理论、又无密钥。
Paper analysisRead analysis
DefensesarXiv 2609.23586Sep 20
VidMark：面向视频生成模型知识产权保护的高效水印方案
提出 VidMark 水印方案，核验视频生成模型的输出来源与所有权
arXiv
2609.23586
Published
Sep 20
Layer
Model layer
Setting
Models and APIs
Evaluated models
Stable Video Diffusion (SVD), Open-Sora, Wan
- DefensesWatermarking and provenance
- AttacksDetection evasion
- ComponentImage generation
AbstractVidMark 加解码器引导微调，把模型签名写入 VGM 输出并用于两项核验。
Huang 等人提出一套面向视频生成模型的生成内嵌水印方案，用来同时判断一条视频是否来自受保护模型，以及一个嫌疑模型是否为该模型的拷贝。
Paper analysisRead analysis
AttacksarXiv 2609.12909Sep 11
研究者在双 T4 上复现并插桩 Tree-Ring 语义水印伪造攻击
复现 Tree-Ring 语义水印的黑盒伪造并恢复检测统计量
arXiv
2609.12909
Published
Sep 11
Layer
Model layer
Setting
Models and APIs
Attacker
Black-box
Evaluated models
Stable Diffusion XL base 1.0
- AttacksDetection evasion
- TechniqueDefense-targeted
- ComponentImage generation
Paper analysisRead analysis
AttacksarXiv 2609.08213Sep 8
DRIFT：通过偏转生成轨迹去除扩散模型水印的黑盒攻击
提出黑盒攻击 DRIFT，偏转生成轨迹以去除扩散水印
arXiv
2609.08213
Published
Sep 8
Layer
Model layer
Setting
Models and APIs
Attacker
Black-box
- AttacksDetection evasion
- TechniqueDefense-targeted
- ComponentImage generation
Paper analysisRead analysis

You have reached the end

AI Safety Daily

Read the latest issueOne issue per day, updated as events develop