Translation in progress Some entries still include text in the original language.
Oct 12 · Monday
All papers Found 16 papers Another 255 papers do not have category tags yet and are not included in filtered results.
“
About this collection Collection in progress We are building a large AI safety paper collection to help researchers find work related to their interests. Papers are collected automatically andfiltered only for relevance to AI safety , without judging quality, novelty or reading value. The default “Annotated first” shows papers with tags or published paper analyses first. Each group is ordered by original publication date, newest first, with undated papers last. “Newest first” uses publication dates only. This order is not a quality ranking.
One-line summaries, tags and paper analyses are prepared by AI from the papers. Language models may have systematic biases and produce hallucinations.We plan to carry out human annotation and review to reduce errors in this content.
Propose KVeil, which adds perturbations to face videos to prevent unauthorized customization from reproducing identity
Published Oct 9
Evaluated models Wan2.2-TI2V-5B , HunyuanVideo-1.5 , Kling 3.0 and others4 Abstract KVeil adapts LETHE's reference-reading disruption to the challenge's two stages, ranking first on the leaderboard in both Final columns.
Proposes LETHE, which perturbs reference images to block unauthorized image-to-video
Published Oct 9
Evaluated models Wan2.1-I2V-14B , CogVideoX-5B-I2V , LightX2V and others6 Abstract LETHE suppresses the diversity of reference values and attracts attention, making protected images difficult to animate faithfully.LETHE is a protective perturbation added to personal images before publication, used to counter unauthorized image-to-video generation.
提出监控深伪基准 CCDF,在统一编码后评测检测器对伪造犯罪事故录像的识别
Published Oct 6
Evaluated models C2P-CLIP , ForgeLens , D3-Im and others10 Abstract 提出消除格式捷径的监控深度伪造基准 CCDF,揭示现有检测器难以识别商用生成视频。
提出校准重合成方法,以生成器反演保真度认证真实图像并防御对抗扰动
Published Oct 5 Abstract 论文提出基于反演保真度与阈值校准的健全认证框架,在对抗扰动下维持错误率界限,并指出真实内容可认证性随生成器演进而萎缩。
提出 TAILOR,按请求组合图像水印以满足抗攻击与画质延迟规格
Published Oct 1 提出 BadAction,通过动作触发器给交互式视频生成植入后门
Published Sep 30
Evaluated models Astra (Wan2.1-T2V-1.3B) 提出带密钥的 SNW,抵御事后图像水印的身份伪造
Published Sep 28
Evaluated models SNW Abstract SNW 用密钥与满秩各向同性投影提高事后水印的 Shannon 容量,并对 PCA 完全安全。Gesny 与 Giboulot 针对生成内容追溯所依赖的多比特事后图像水印,批评端到端 DNN 方案既无容量理论、又无密钥。
提出 VidMark 水印方案,核验视频生成模型的输出来源与所有权
Published Sep 20
Evaluated models Stable Video Diffusion (SVD) , Open-Sora , Wan Abstract VidMark 加解码器引导微调,把模型签名写入 VGM 输出并用于两项核验。Huang 等人提出一套面向视频生成模型的生成内嵌水印方案,用来同时判断一条视频是否来自受保护模型,以及一个嫌疑模型是否为该模型的拷贝。
复现 Tree-Ring 语义水印的黑盒伪造并恢复检测统计量
Published Sep 11
Evaluated models Stable Diffusion XL base 1.0 提出黑盒攻击 DRIFT,偏转生成轨迹以去除扩散水印
Published Sep 8 提出 DIVA,将有害意图拆成视觉锚点与运动文本以越狱视频生成模型
Published Sep 7
Evaluated models Wan , CogVideoX , LTX-Video and others9 Abstract DIVA 用视觉锚点抑制语义漂移做视频越狱,并给出多条件安全基准 TI2VSafetyBench。DIVA 是针对带参考图的视频生成模型的免训练 black-box 越狱:用一致性机制本身堵住语义漂移这条安全逃逸路径。 。
提出 DSR 跨模态越狱,用无害图文诱导 MLLM 生成有害图像
Published Jun 1
Evaluated models gemini-2.5-flash-image , qwen-image-2.0 , Tongyi Wanx 2.5 Abstract DSR 用无害图文诱导商业 MLLM 输出有害图像,作者称组合能力会反过来扩大攻击面。DSR 是一种 black-box 跨模态越狱:输入侧不放显式有害内容,而让商业 MLLM 在推理中把无害图文重组成有害图像。
提出 RA-Det,利用鲁棒性不对称检测 AI 生成图像
Published Mar 2 Abstract RA-Det 把扰动下特征漂移差变成检测信号,平均 ACC 高于表中通用检测器,但不是每行最高。RA-Det 是合成图像检测器,用扰动下的表示稳定性差异代替外观痕迹。
提出纯视觉越狱攻击 VJA,把有害编辑指令编码进图像
Published Feb 11
Evaluated models Nano Banana Pro , GPT Image 1.5 , Qwen-Image-Edit and others9 提出 BVS 图文越狱,用中和拼接图和诱导提示词让模型生成有害图像
Published Jan 22
Evaluated models GPT-5 (12 January 2026 release) , Gemini 1.5 Flash (15 January 2026 release) Abstract BVS 以重建后再生成诱导有害图像。BVS 用图文对诱导 MLLM 生成有害图像。作者认为,相对文本越狱和单模态图像诱导,视觉生成的安全审查仍不充分。
Attacks arXiv 2508.06837 · Aug 9, 2025 提出 Prometheus,从展示图反推文生图模型的在售提示词
Published Aug 9, 2025
Evaluated models Midjourney , Leonardo.ai , DALL·E and others4 Abstract 训练无关的 proxy 搜索攻击。Prometheus 是针对文生图市场 showcase 的训练无关提示词窃取:攻击者看不到在售文本,只用本地开源 proxy 恢复 subject 和 modifier,并希望换 subject 后风格仍在。
You have reached the end