DefensesarXiv 2608.25431
GIFT: Enforcing User Data Isolation in LLM Serving via GPU Information Flow Tracking
Propose GIFT, isolating user data in shared LLM serving using encryption and GPU information flow tracking
- arXiv
- 2608.25431
- Published
- Layer
- Infrastructure layer
- Setting
- Models and APIs
- Evaluated models
- Qwen2.5-14B, Qwen2.5-32B, Qwen2.5-72B and others6
- DefensesInstruction–data separation
- AttacksExtraction and theft
AbstractGIFT uses cryptographic isolation plus GPU information flow rules to enforce user data isolation on vLLM and DistServe, and reports throughput overhead.
GIFT is the authors' user data isolation system for shared LLM serving, with GIFT-CC enabling confidential computing. In the conclusion, the authors state it is the first IFT design for this scenario.