Skip to content

Translation in progress Some entries still include text in the original language.

Oct 12 · Monday

All papers

Found 7 papers
Filter4

Attack type

Jailbreaks50Poisoning and backdoors3Extraction and theft7Malicious use5

Impact

Data and privacy leaks6

System type

Models and APIs4

Attacker access

Black-box4

Attack surface / entry point

User input7Retrieval corpus3Images, audio and video4Weights and gradients3

Layer

Application layer3

System component

RAG5Reasoning chains5Fine-tuning and open weights3Embeddings1Multimodal6
Select any value within a category; different categories must all match. Counts include the other filters you have selected.Another 254papers have no tags yet and are not included in filtered results.
Attack type：Extraction and theftAttack surface / entry point：User inputSystem component：EmbeddingsSystem component：MultimodalClear all

Another 254papers do not have category tags yet and are not included in filtered results.

  2. Evaluation and benchmarksarXiv 2609.33481

    IDUnlearn-Bench：面向视觉语言模型的个体级遗忘基准

    提出 IDUnlearn-Bench，评测 VLM 个体级遗忘后的身份残留

    arXiv
    2609.33481
    Published
    Layer
    Training and data layer
    Setting
    Models and APIs
    Evaluated models
    Qwen3-VL-2B, Qwen3-VL-4B, Qwen3-VL-8B and others6
    AbstractIDUnlearn-Bench 用四族探针显示：压低直接属性访问后，身份仍常能被反向查出、绑定或重构。

    IDUnlearn-Bench 评测 VLM 是否忘掉一个可跨模态识别的人，而不只是答不出某条监督事实。

    Paper analysisRead analysis
  4. AttacksarXiv 2609.01723

    研究者提出针对微调 TTS 模型的黑盒成员推断攻击

    提出针对微调 TTS 的黑盒成员推断攻击

    arXiv
    2609.01723
    Published
    Layer
    Model layer
    Setting
    Models and APIs
    Attacker
    Black-box
    Evaluated models
    CosyVoice2, F5-TTS, XTTS-v2
    Abstract黑盒 TTS 成员推断以 recitation 加分层语音表示为分数，说话人级强于记录级，DP-SGD 可压到随机附近。

    作者给出一个针对微调文本转语音模型的黑盒成员推断框架，分别审计说话人是否进入微调集，以及某一条文本–音频记录是否进入微调集。微调 TTS 以合成文本和参考语音双条件生成，既有生成模型 MIA 的单条件查询和图像/文本上的逐点比较不能直接套用。作者用 scorable extent 与 memorization elicitation 比较五种查询，认为只有 recitation（用目标转写和干净目标语音要求模型复现）同时满足两条，并把它作为主查询。

    Paper analysisRead analysis
  5. AttacksarXiv 2607.01276

    研究者提出嵌入推断攻击 EIA，可在黑盒 IR 系统中识别所用嵌入模型

    提出嵌入推断攻击 EIA，在黑盒 IR 中识别所用嵌入模型

    arXiv
    2607.01276
    Published
    Layer
    Application layer
    Setting
    LLM applications
    Attacker
    Black-box
    Evaluated models
    e5-small, e5-small-v2, e5-base and others19
    AbstractEIA 用无序文档集的差异从候选中识别嵌入模型，并给出 reranker 与阈值下的计数。

    EIA 是在黑盒 IR 上识别所用嵌入模型的攻击。。

    Paper analysisRead analysis
  6. AttacksarXiv 2602.07379

    Aegis: Governance, Integrity, and Security for AI Voice Agents

    提出 Aegis 红队框架，多轮攻击高风险语音 Agent

    arXiv
    2602.07379
    Published
    Layer
    Application layer
    Setting
    AI Agent
    Evaluated models
    GPT-4o, GPT-4o-mini, Gemini-1.5 Pro and others7
    AbstractAegis red-teams three types of voice agents: query-based access eliminates authentication and leakage successes, but behavioral attacks remain.

    Aegis uses multi-turn red-teaming evaluation on ALLM voice agents already integrated into business systems. The authors call this the first systematic red-teaming framework in this setting.

    Paper analysisRead analysis
You have reached the end