Skip to content

Translation in progress Some entries still include text in the original language.

Oct 12 · Monday

All papers

Found 49 papers
Filter3

Attack type

Jailbreaks42Poisoning and backdoors5Detection evasion3

Attack technique

Gradient and representation optimization24Automated search46Multi-turn escalation22Encoding and obfuscation37Role-play and persuasion17Conversation structure manipulation9Reasoning-chain manipulation6Cross-modal payloads32Defense-targeted9Dormant triggers4

Impact

Harmful content49Unauthorized actions39Data and privacy leaks21Output manipulation41Availability and reliability8

System type

Models and APIs44AI Agent3

Attacker access

Black-box35Gray-box3

Attack surface / entry point

User input44Images, audio and video12Training data4

Layer

Prompt layer40Application layer5Training and data layer4

System component

Guardrails and judges12Fine-tuning and open weights4Vision9Image generation5Multimodal17
Select any value within a category; different categories must all match. Counts include the other filters you have selected.Another 265papers have no tags yet and are not included in filtered results.
Attack technique：Automated searchAttack technique：Dormant triggersImpact：Harmful contentClear all

Another 265papers do not have category tags yet and are not included in filtered results.

  2. AttacksarXiv 2610.07723

    Researchers propose answer-side backdoors: letting the model self-generate trigger words to bypass safety refusals.

    提出回答端后门，让模型自生成触发词以在干净有害请求下绕过拒答

    arXiv
    2610.07723
    Published
    Layer
    Training and data layer
    Setting
    Models and APIs
    Evaluated models
    Llama-2-7B-chat-hf, Mistral-7B-Instruct-v0.3, Gemma-7B-it and others4

    Abstract论文提出了多轮对话中回答端自生成触发词绕过安全拒绝的后门攻击，指出输入端防护存在盲区。

    Paper analysisRead analysis
  3. AttacksarXiv 2610.07654

    研究揭示策略蒸馏的安全后门风险

    测量带后门教师经 OPD 向干净学生迁移潜伏后门

    arXiv
    2610.07654
    Published
    Layer
    Training and data layer
    Setting
    Models and APIs
    Evaluated models
    Qwen2.5-1.5B-Instruct, Qwen2.5-3B-Instruct, Qwen2.5-7B-Instruct
    Abstract作者称 OPD 可在压低无触发词有害率时迁入后门。

    带后门的外部教师经 OPD，可在压低无触发词有害率的同时，把触发条件下的有害行为传给初始干净学生。。

    Paper analysisRead analysis
  5. AttacksarXiv 2610.01367

    研究：高质量数据筛选挡不住投毒

    提出 Bi-QSTO，优化能穿过质量筛选并在微调中削弱安全对齐的投毒样本

    arXiv
    2610.01367
    Published
    Layer
    Training and data layer
    Setting
    Models and APIs
    Evaluated models
    Llama2-7B-Chat, Llama3-8B-Instruct, Qwen2-7B-Instruct and others5
    Abstract质量筛选挡不住部分高分样本的安全削弱。

    Bi-QSTO 研究一个实际训练缺口：基于质量的数据选择会先于微调决定样本去留，而以往微调投毒多假设毒样本直接进入训练集。已对齐 LLM 的拒答会被少量有害或看似无害的微调样本削弱。作者用三个问题串起实验：选择能否排除毒样本。

    Paper analysisRead analysis
  8. AttacksarXiv 2609.36474

    FinRT：将自适应红队策略蒸馏为消费金融领域的可复用对抗生成器

    提出 FinRT，将消费金融自适应红队轨迹蒸馏为可复用对抗提示生成器

    arXiv
    2609.36474
    Published
    Layer
    Prompt layer
    Setting
    Models and APIs
    Attacker
    Black-box
    Evaluated models
    Llama-3.3-70B, Llama-3.1-8B, Mixtral-8x7B and others6
    AbstractFinRT 用前向失效发现加校准代理 DPO，把消费金融红队收成单次前向生成器。

    FinRT 是面向消费金融的红队框架：先发现政策失效，再训练一个按政策、领域与目标行为出提示的生成器。

    Paper analysisRead analysis
  11. AttacksarXiv 2609.07048

    FreqDoor：面向视觉语言模型的频域后门攻击

    提出 FreqDoor，在频域混合振幅并对生成式 VLM 做训练时视觉后门

    arXiv
    2609.07048
    Published
    Layer
    Training and data layer
    Setting
    Models and APIs
    Evaluated models
    BLIP-2 (opt-2.7b), InstructBLIP (flan-t5-xl), LLaVA (interleave-qwen)
    AbstractFreqDoor 用频域振幅混合给三款 VLM 植入仅视觉的训练时后门。

    FreqDoor 是针对生成式 VLM 的仅视觉、训练时后门：在频域混合触发源振幅、保留干净图像相位，使触发在空间上分散。

    Paper analysisRead analysis
  13. AttacksarXiv 2609.01168

    CRACK：用多智能体辩论越狱多层安全过滤的 T2I 模型

    提出 CRACK，用多智能体辩论在黑盒下越狱文生图多层安全过滤

    arXiv
    2609.01168
    Published
    Layer
    Prompt layer
    Setting
    Models and APIs
    Attacker
    Black-box
    Evaluated models
    Stable Diffusion v1.4, SDXL, DALL·E 3 and others4
    AbstractCRACK 以分层诊断的多智能体辩论搜索多层 T2I 过滤器的联合规避区域。

    CRACK 是面向文本生成图像模型多层安全栈的黑盒越狱框架，用几何上的 Detection Surface 解释为何粗粒度反馈不够。

    Paper analysisRead analysis
  18. AttacksarXiv 2607.18056

    上海 AI 实验室提出 Intern-BioBreaker，在 14 个前沿模型上暴露生物安全越狱风险

    提出生物红队模型 Intern-BioBreaker，多轮越狱诱导模型输出可操作生物危害

    arXiv
    2607.18056
    Published
    Layer
    Prompt layer
    Setting
    Models and APIs
    Evaluated models
    DeepSeek-V3, Kimi-K2.6, DeepSeek-V4-Pro and others14

    Abstract论文通过构建专用红队模型评估前沿大模型的生物安全漏洞与物理转化风险。

    Paper analysisRead analysis
  19. AttacksarXiv 2607.02961

    研究者提出信息过载方法越狱大型视觉语言模型

    提出 INFER+ 信息过载方法，越狱大型视觉语言模型

    arXiv
    2607.02961
    Published
    Layer
    Prompt layer
    Setting
    Models and APIs
    Attacker
    Black-box, Gray-box
    Evaluated models
    Qwen3-VL-8B, Qwen2-VL-7B, InternVL3.5-8B and others8
    Abstract用图文过载越狱 LVLM。

    这篇工作用信息过载越狱 LVLM，而不是靠 OOD 变换隐藏意图。

    Paper analysisRead analysis
Load more