Skip to content
arXiv· arXiv:2604.18231· Sina Abdollahi, Mohammad M Maheri, Javad Forough, Amir Al Sadi, Josh Millar, David Kotz, Marios Kogias, Hamed Haddadi·Indexed by this site · Originally published

AgenTEE: Executing Confidential LLM Agents on Edge Devices

AgenTEE: Confidential LLM Agent Execution on Edge Devices

AI summary

The researchers propose AgenTEE, which uses independently attested confidential virtual machines based on Arm CCA to isolate the LLM agent runtime, inference engine, and third-party applications. Each component runs in a separately attested cVM and interacts through explicit and verifiable communication channels to protect system prompts, model weights, and runtime state. Evaluation shows that this multi-cVM system incurs less than 5.15% runtime overhead compared with multi-process deployment on a commercial OS, approaching native performance.

Read originalProceedings of the Sixth European Workshop on Machine Learning and Systems