TrojanRAG: Retrieval-augmented generation can become a backdoor driver for large language models
TrojanRAG: Retrieval-Augmented Generation Can Be Backdoor Driver in Large Language Models
Researchers propose TrojanRAG, a method that carries out joint backdoor attacks in retrieval-augmented generation, thereby manipulating large language models in general scenarios. The attacker constructs target contexts and trigger sets, uses contrastive learning to orthogonally optimize multiple sets of backdoor shortcuts, and constrains trigger conditions to a parameter subspace to improve matching. To improve RAG's recall of target contexts, the method introduces knowledge graph construction of structured data to achieve hard matching at a fine-grained level. The authors also formalize backdoor scenarios for large language models from the perspectives of attackers and users, and examine whether context can become a jailbreak tool. Experiments on factuality, language understanding, and harmfulness tasks show that TrojanRAG poses multifaceted threats while maintaining normal query retrieval capability.
Related events and news
1 events · 1 news mentions
- The reports mention TrojanRAG
研究:17款主流LLM中94.1%存在智能体攻击漏洞
News that mentions this paper
研究:17款主流LLM中94.1%存在智能体攻击漏洞
- 公众号 为机器立心names the paper意大利卡拉布里亚大学:17 款主流 LLM 中 94.1% 至少存在一类智能体攻击漏洞
现有研究(如TrojanRAG、PoisonedRAG)主要通过污染RAG知识库使LLM生成攻击者指定的错误答案或引入偏见,未涉及诱导LLM执行危害系统安全的操作;