Perturbation and de-alignment testing of a backpack store's AI assistant
Mareando y Desalineando a un Asistente IA de una tienda de Mochilas.
AI summary
A security researcher conducted de-alignment testing on a backpack store's LLM assistant. By embedding instructions in product name tokens within a recommended backpack list, they successfully bypassed its two-layer guardrails of prompt and output. The assistant had no internet access and no programming capability, but the researcher repeatedly broke through the output filtering using ASCII encoding, acrostics, and ELITE language, and extracted the System Prompt configuration. Based on this, the researcher suggested that LLM assistants need focused protection, as cybercriminals are already eyeing such models.