AttacksarXiv 2603.16960
Adversarial attacks against modern vision-language models
Conduct adversarial attacks on product images for open-source visual shopping agents and induce wrong purchases
- arXiv
- 2603.16960
- Published
- Layer
- Application layer
- Setting
- web agent
- Evaluated models
- LLaVA-v1.5-7B, Qwen2.5-VL-7B
- AttacksPrompt injection
- TechniqueGradient and representation optimization
- ComponentVision
AbstractThe authors state that LLaVA is easily induced by three attacks to buy the wrong item, while Qwen's correct purchase rate remains close to its clean condition.
The authors compare the robustness of two open-source VLM shopping agents against image adversarial perturbations in a self-built e-commerce environment.