Select any value within a category; different categories must all match. Counts include the other filters you have selected.Another 201papers have no tags yet and are not included in filtered results.

Attack type：Model tampering Attack type：Extraction and theft Attack type：Malicious use Attack surface / entry point：Weights and gradients Layer：Model layer Clear all

Another 201papers do not have category tags yet and are not included in filtered results.

InterpretabilityarXiv 2610.09000Oct 7
研究定位 LLaMA-2-7B-Chat 安全敏感参数
定位安全敏感参数并稀疏改动权重以削弱安全对齐
arXiv
2610.09000
Published
Oct 7
Layer
Model layer
Setting
Models and APIs
Evaluated models
LLaMA-2-7B-Chat
- AttacksModel tampering
- RiskInappropriate refusal
Paper analysisRead analysis
AttacksarXiv 2610.05894Oct 5
研究者提出闭环偏见注入攻击
提出闭环激活引导，在扩散语言模型去噪过程中注入定向偏见
arXiv
2610.05894
Published
Oct 5
Layer
Model layer
Setting
Models and APIs
Attacker
Gray-box
Evaluated models
LLaDA-8B-Instruct, Dream-v0-Instruct-7B, LLaDA-MoE-7B-A1B-Instruct
- AttacksModel tampering
- TechniqueGradient and representation optimization
Abstract通过去噪中间概率反馈动态调节残差流转向，证明扩散语言模型在推理服务栈中存在闭环偏见注入脆弱性。
Paper analysisRead analysis
AttacksarXiv 2610.05601Oct 5
Tracer 框架可从遗忘后的扩散模型中识别被擦除概念
提出 TRACER，从权重差识别扩散模型被擦除概念
arXiv
2610.05601
Published
Oct 5
Layer
Model layer
Setting
Models and APIs
Attacker
White-box
Evaluated models
Stable Diffusion v1.5, Stable Diffusion 3, FLUX.1 and others5
- AttacksExtraction and theft
- ComponentImage generation
AbstractTRACER 用权重足迹识别未披露擦除概念并估计个数，作者称数秒内完成且准确率高于对照。
TRACER 针对的是遗忘扩散模型上的目标识别：提供者从公开基座 W 用已发表方法擦掉未知集合 S⋆，只发布 W′。攻击者还有假定包含这些概念的词表，但不知擦了谁、擦了几个、用了什么算法。
Paper analysisRead analysis
AttacksarXiv 2610.03124Oct 2
研究提出 Untag 攻击框架，使开源大模型触发标签滥用检测机制失效
提出 UNTAG，绕过开源权重模型的 trigger-tag 滥用检测
arXiv
2610.03124
Published
Oct 2
Layer
Model layer
Setting
Models and APIs
Attacker
Black-box, White-box
Evaluated models
Llama2 (7B), Llama3 (8B), Qwen2.5 (7B)
- AttacksDetection evasion
- TechniqueDefense-targeted
- ComponentFine-tuning and open weights
Abstract作者用 UNTAG 评估 trigger-tag，认为其不能充当开放权重滥用检测的主要边界。
UNTAG 是针对开放权重 LLM 上条件滥用检测 trigger-tag 的统一攻击评估：信号可以在解码期注入，也可以写进权重，但攻击者若能改输出或改已发布权重，检测可以失效。
Paper analysisRead analysis
AttacksarXiv 2610.01062Oct 1
Kernelized Activation Steering：将激活引导推广到再生核希尔伯特空间的新框架
提出核化激活引导 KAS，在推理时自适应转向激活以诱导越狱
arXiv
2610.01062
Published
Oct 1
Layer
Model layer
Setting
Models and APIs
Evaluated models
Qwen2.5-7B-Instruct, Gemma-2-9B-IT, Llama-3.1-8B-Instruct and others4
- AttacksModel tampering
- TechniqueGradient and representation optimization
AbstractKAS 用核梯度做局部自适应转向，并在线性核下恢复 DiM。
Kernelized Activation Steering（KAS） 把推理时的激活转向写成核空间中的优化，使更新随当前激活相对源、目标参考集的位置而变化。
Paper analysisRead analysis
DefensesarXiv 2609.23586Sep 20
VidMark：面向视频生成模型知识产权保护的高效水印方案
提出 VidMark 水印方案，核验视频生成模型的输出来源与所有权
arXiv
2609.23586
Published
Sep 20
Layer
Model layer
Setting
Models and APIs
Evaluated models
Stable Video Diffusion (SVD), Open-Sora, Wan
- DefensesWatermarking and provenance
- AttacksDetection evasion
- ComponentImage generation
AbstractVidMark 加解码器引导微调，把模型签名写入 VGM 输出并用于两项核验。
Huang 等人提出一套面向视频生成模型的生成内嵌水印方案，用来同时判断一条视频是否来自受保护模型，以及一个嫌疑模型是否为该模型的拷贝。
Paper analysisRead analysis
DefensesarXiv 2609.16229Sep 15
ARIA：用稀疏自编码器实现测试时机器遗忘
提出 ARIA，在冻结权重上用 SAE 做推理时遗忘门控
arXiv
2609.16229
Published
Sep 15
Layer
Model layer
Setting
Models and APIs
Attacker
White-box
Evaluated models
DeepSeek-R1-Distill-Qwen-1.5B, Gemma-3-1B-it
- DefensesInference-time intervention
- AttacksExtraction and theft
- ComponentReasoning chains
Paper analysisRead analysis
AttacksarXiv 2609.10117Sep 9
研究揭示基于混淆的端侧 LLM 保护方案的安全边界
提出 Collapse，从端侧混淆暴露视图抽取高效用替代模型
arXiv
2609.10117
Published
Sep 9
Layer
Model layer
Setting
Models and APIs
Evaluated models
BERT-Base, ViT-Base, Qwen2.5-0.5B and others4
- AttacksExtraction and theft
- TechniqueDefense-targeted
AbstractOprior 是四原语复合的安全边界，Collapse 利用列方向泄漏抽取替代模型，Oext 只被同一攻击评测。
这篇工作用代数原语统一若干 TEE 卸载混淆，给出该族的典范边界，再说明该边界挡不住一种分阶段模型抽取。。
Paper analysisRead analysis
Evaluation and benchmarksarXiv 2609.08901Sep 8
论文揭示 BatchNorm 架构下机器遗忘评测的归一化伪影
诊断 BatchNorm 架构下机器遗忘评测的归一化伪影
arXiv
2609.08901
Published
Sep 8
Layer
Model layer
Setting
Models and APIs
Evaluated models
ResNet-18, ResNet-50, ViT-S/16 and others4
- DefensesModel hardening
- AttacksModel tampering
Abstract一次不改权重的 BN 重校准能翻转多数方法的表面遗忘，但不改变权重里的编码器泄露。
BN illusion 是作者对近似机器遗忘评测中一种 BatchNorm 测量伪影的命名：不改权重、只用 retain 数据重算运行统计，就可以把表面遗忘准确率翻过来。
Paper analysisRead analysis
AttacksarXiv 2608.29458Aug 30
Reference-Grafting 在提取沙袋行为隐藏能力上追平微调
提出参考嫁接，在推理阶段用激活干预诱导沙袋隐藏能力
arXiv
2608.29458
Published
Aug 30
Layer
Model layer
Setting
Models and APIs
Attacker
White-box
Evaluated models
Qwen2.5-1.5B, Qwen2.5-3B, Qwen2.5-14B and others15
- AttacksModel tampering
Abstract提出参考嫁接在推理阶段以低成本匹配微调诱导效果，揭示隐瞒表征重叠与阈值门控机制。
Paper analysisRead analysis
DefensesarXiv 2608.05578Aug 6
AMS 工具通过激活分析检测语言模型的安全训练改动
提出 AMS，用激活分离与方向相似度检测安全训练改动
arXiv
2608.05578
Published
Aug 6
Layer
Model layer
Setting
Models and APIs
Evaluated models
Llama-3.1-8B-Instruct, Llama-3.2-3B-Instruct, Llama-3.2-1B-Instruct and others14
- DefensesMonitoring and auditing
- AttacksModel tampering
- ComponentFine-tuning and open weights
AbstractAMS 按激活签名把安全改动分四类，前三类可由两级扫描覆盖，行为微调会漏。
AMS 是面向开放权重模型、部署前使用的激活扫描器，用来看安全训练被拿掉或改写之后，激活空间里还留着什么几何痕迹。
Paper analysisRead analysis
AttacksarXiv 2605.08513May 9
Apple 研究者发现抑制单个神经元即可绕过 LLM 安全对齐
提出单神经元激活干预，抑制拒答神经元或放大概念神经元以绕过安全对齐
arXiv
2605.08513
Published
May 9
Layer
Model layer
Setting
Models and APIs
Attacker
White-box
Evaluated models
Qwen3-1.7B, Qwen3-4B, Qwen3-8B and others11
- AttacksModel tampering
- TechniqueGradient and representation optimization
Abstract作者称大模型安全由拒答门控与概念底座构成，干预单个神经元足以双向击穿对齐，且拒答神经元在预训练阶段已然存在。
Paper analysisRead analysis
AttacksarXiv 2604.10326Apr 12
HMNS：通过注意力头掩蔽与零空间注入实现机制级越狱
提出 HMNS，通过注意力头掩码与零空间注入实现机制级越狱
arXiv
2604.10326
Published
Apr 12
Layer
Model layer
Setting
Models and APIs
Attacker
White-box
Evaluated models
LLaMA-2-7B-Chat, Phi-3-Medium-4K-Instruct, LLaMA-3.1-70B and others6
- AttacksJailbreaks
Paper analysisRead analysis
Analysis and theoryarXiv 2604.02574Apr 3
Understanding the impact of safety unalignment on large language models
Comparing jailbreak fine-tuning and weight orthogonalization unalignment on harmful assistance and usefulness
arXiv
2604.02574
Published
Apr 3
Layer
Model layer
Setting
Models and APIs
Evaluated models
Qwen3-4B-Instruct-2507, Llama-3.1-8B-Instruct, Qwen2.5-14B and others6
- AttacksModel tampering
- ComponentFine-tuning and open weights
Paper analysisRead analysis
AttacksarXiv 2603.10080Mar 10
Amnesia: Adversarial Activation Steering on Specific Semantic Layers of Large Language Models
Propose the Amnesia activation-guided attack to bypass model safety refusal during inference
arXiv
2603.10080
Published
Mar 10
Layer
Model layer
Setting
Models and APIs
Attacker
White-box
Evaluated models
Llama-2-7B-Chat, Llama-3-8B-Instruct, Qwen-7B-Chat
- AttacksModel tampering
- TechniqueGradient and representation optimization
Paper analysisRead analysis
AttacksarXiv 2603.04355Mar 5
Efficient refusal ablation for large language models via optimal transport
Propose PCA-OT representation-layer refusal ablation, rewriting activations at inference time to bypass refusals
arXiv
2603.04355
Published
Mar 5
Layer
Model layer
Setting
Models and APIs
Attacker
White-box
Evaluated models
Llama-2-7b-chat-hf, Llama-2-13b-chat-hf, Llama-3.1-8B-Instruct and others6
- AttacksModel tampering
Paper analysisRead analysis
AttacksarXiv 2602.10134Feb 7
Reverse-Engineering Model Editing on Language Models
提出 KSTER，从模型编辑的参数差恢复被擦除知识
arXiv
2602.10134
Published
Feb 7
Layer
Model layer
Setting
Models and APIs
Attacker
White-box
Evaluated models
Llama3-8B-Instruct, GPT-J (6B), Qwen2.5-7B-Instruct
- DefensesModel hardening
- AttacksExtraction and theft
AbstractKSTER 从 locate-then-edit 的权重差恢复主体与提示词。
KSTER 是针对 locate-then-edit 的白盒逆向框架，并配有子空间伪装防御。
Paper analysisRead analysis
AttacksarXiv 2602.05444Feb 5
Causal front-door adjustment for robust jailbreak attacks on LLMs
Proposes CFA2, using SAE to locate defense directions and orthogonalizing output weights to achieve jailbreak
arXiv
2602.05444
Published
Feb 5
Layer
Model layer
Setting
Models and APIs
Attacker
White-box
Evaluated models
Llama 3.1 8B Instruct, Llama2 7B Chat, Mistral 7B Instruct and others4
- AttacksModel tampering
- TechniqueGradient and representation optimization
- ComponentFine-tuning and open weights
Paper analysisRead analysis
AttacksarXiv 2601.18110Jan 26
AttenMIA: Membership Inference Attacks on LLMs Using Attention Signals
提出 AttenMIA，用注意力信号做白盒成员推断
arXiv
2601.18110
Published
Jan 26
Layer
Model layer
Setting
Models and APIs
Attacker
White-box
Evaluated models
LLaMA-13B, LLaMA-30B, Pythia-6.9B and others12
- AttacksExtraction and theft
AbstractAttenMIA 用白盒注意力做成员推断，作者称在低假阳性下优于输出类基线。
AttenMIA 是面向开源权重 LLM 的白盒、reference-free 成员推断：读内部注意力，而不是只看输出置信度，判断样本是否在训练集中。
Paper analysisRead analysis
AttacksarXiv 2601.15801Jan 22
Attributing and Exploiting Safety Vectors in Large Language Models via Global Optimization
提出 GOSV，全局优化定位安全注意力头并在推理时重贴激活越狱
arXiv
2601.15801
Published
Jan 22
Layer
Model layer
Setting
Models and APIs
Attacker
White-box
Evaluated models
Llama-2-7b-chat, Llama-3.1-8B-Instruct, Qwen2.5-7B-Instruct and others4
- AttacksModel tampering
- TechniqueGradient and representation optimization
Paper analysisRead analysis

AI Safety Daily

Read the latest issueOne issue per day, updated as events develop