Translation in progress Some entries still include text in the original language.

Oct 12 · Monday

All papers

Found 8 papers

Filter3

Attack type

Jailbreaks197 Prompt injection9 Poisoning and backdoors6 Model tampering3 Extraction and theft39 Detection evasion16 Denial of service3 Malicious use8

Impact

Harmful content4

System type

Models and APIs8 AI Agent11 coding agent4

Attack surface / entry point

User input8 Images, audio and video6

Layer

Model layer4

System component

Image generation4 Multimodal5

Select any value within a category; different categories must all match. Counts include the other filters you have selected.Another 261papers have no tags yet and are not included in filtered results.

Attack type：Malicious use System type：Models and APIs Attack surface / entry point：User input Clear all

Another 261papers do not have category tags yet and are not included in filtered results.

DefensesarXiv 2610.08316Oct 6
MARCO：面向蛋白质生成模型的放射性水印框架
提出 MARCO 放射性水印，冻结蛋白质生成模型并在去噪时嵌入签名
arXiv
2610.08316
Published
Oct 6
Layer
Model layer
Setting
Models and APIs
Attacker
Black-box
Evaluated models
RFdiffusion, ESMFold, Chroma and others6
- DefensesWatermarking and provenance
- AttacksExtraction and theft
AbstractMARCO 在冻结的 PGM 上去噪时嵌构象水印，作者称能兼顾保真与抗扰动，并使盗版模型继承水印。
MARCO 是加在蛋白质生成模型推理过程上的构象水印，用来标记知识产权，并为可能的生物安全滥用保留可追溯信号。作者还把它说成数字权利管理工具，以及符合生物武器公约的数字监管链。问题在于：专有 PGM 的三维输出可能被拿去训练盗版模型，也可能在来源被抹掉后绕过筛查。
Paper analysisRead analysis
Evaluation and benchmarksarXiv 2610.06503Oct 5
研究评测五款开源文生图模型的有害内容生成与审核缺口
评测文生图模型的有害内容生成能力与审核检测缺口
arXiv
2610.06503
Published
Oct 5
Layer
Model layer
Setting
Models and APIs
Evaluated models
SDXL, Stable Diffusion 3.5 Large, FLUX.1-dev and others12
- DefensesDetection and filtering
- AttacksMalicious use
- ComponentImage generation
Paper analysisRead analysis
DefensesarXiv 2610.03980Oct 3
FADE：面向视频扩散模型的帧感知多概念擦除框架
提出 FADE，对文生视频模型做帧感知多概念擦除
arXiv
2610.03980
Published
Oct 3
Layer
Training and data layer
Setting
Models and APIs
Evaluated models
Wan2.1-T2V-1.3B, Wan2.1-T2V-14B, CogVideoX-2B and others4
- DefensesModel hardening
- AttacksMalicious use
- ComponentImage generation
AbstractFADE 用闭式编辑、帧感知适配器和软路由，在单骨干上擦除多概念并压低逐帧残差。
FADE 是面向文生视频扩散 Transformer 的多概念遗忘方法，用来抑制指定物体、画风、裸体、暴力、仇恨和名人身份，并尽量保持其他生成。作者要处理两件事。与帧无关的抑制会让概念在少数帧重现，片段均值会掩盖这一失败。
Paper analysisRead analysis
Evaluation and benchmarksarXiv 2609.35028Sep 28
VEX-Bench：评测 LLM 生成虚假信息的核验复杂度
提出 VEX-Bench 评测 LLM 生成虚假信息的核查复杂度
arXiv
2609.35028
Published
Sep 28
Layer
Prompt layer
Setting
Models and APIs
Evaluated models
Claude Sonnet 4.5, Gemini 3.1 Pro, GPT-5.4 and others7
- AttacksMalicious use
AbstractVEX-Bench 用筛查时的五维复杂度衡量虚假信息对核查容量的占用，并报告生成与核查的成本差。
VEX-Bench 把 LLM 虚假信息的风险从“能否生成”改成“筛查时会占用多少核查容量”。
Paper analysisRead analysis
DefensesarXiv 2609.03629Sep 3
EraseSAE：用稀疏自编码器在文生视频扩散模型中实现精准概念擦除
提出 EraseSAE，在文生视频模型中局部擦除指定概念
arXiv
2609.03629
Published
Sep 3
Layer
Model layer
Setting
Models and APIs
Evaluated models
CogVideoX-5B, HunyuanVideo, Flux.1 [dev]
- DefensesInference-time intervention
- AttacksMalicious use
- ComponentImage generation
AbstractEraseSAE 用单义特征局部擦除。
EraseSAE 把 SAE 用于 DiT 文生视频模型的概念擦除。作者要解决的是：全局改权重或表面负提示对不齐细粒度、分布式的概念，而且会改到无关时空区域。
Paper analysisRead analysis
DefensesarXiv 2608.29030Aug 29
研究者提出自蒸馏方法让 LLM 遵循上下文水印指令
提出 SDLP 与 GRPO，训练模型遵循上下文水印指令
arXiv
2608.29030
Published
Aug 29
Layer
Training and data layer
Setting
Models and APIs
Evaluated models
GPT-5.4, GPT-5.4-mini, GPT-5.4-nano and others14
- DefensesWatermarking and provenance
- AttacksMalicious use
Paper analysisRead analysis
DefensesarXiv 2602.20880Feb 24
When safety conflicts: resolving multi-category harmful conflicts in text-to-image diffusion models with adaptive safety guidance
提出 CASG，解决文生图多类别安全引导的方向冲突
arXiv
2602.20880
Published
Feb 24
Layer
Model layer
Setting
Models and APIs
Evaluated models
Stable Diffusion v1.5, SDv3
- DefensesInference-time intervention
- AttacksMalicious use
- ComponentImage generation
Paper analysisRead analysis
AttacksarXiv 2601.12983Jan 19
ChartAttack：测试大语言模型在图表生成中对恶意提示的脆弱性
提出 ChartAttack，用恶意提示驱动代码模型生成误导图表
arXiv
2601.12983
Published
Jan 19
Layer
Prompt layer
Setting
Models and APIs
Evaluated models
Claude-4.6-Sonnet, GPT-4o, Gemini-2.5-Flash and others20
- AttacksMalicious use
- ComponentVision
AbstractChartAttack 生成不改数据的误导图，降低 MLLM 与人类的图表问答准确率。
ChartAttack 研究恶意提示能否让 MLLM 在不改数据的情况下生成误导图表，并量化这些图对其他 MLLM 和人类图表问答的影响。
Paper analysisRead analysis

You have reached the end

AI Safety Daily

Read the latest issueOne issue per day, updated as events develop