Skip to content

Poisoned skills: jailbreaks spread through Agent Markdown files

Poisoned Skills: Propagating Jailbreaks Through Agent Markdown Files

arXiv: Jailbreaks, Prompt Injection, Poisoning & Defenses· arXiv:2610.37738· Kashyap R Manjusha, Murali Emani·Indexed by this site · 14 days ago· Originally publishedAttacks
AI summary

The researchers demonstrated an attack that spreads jailbreaks through Agent Markdown skill files; the average attack success rate across seven open-weight models rose from 0.5% to 45%, reaching 68.9% on an individual model. The experiment built a LangChain question-answering Agent whose system prompt is assembled from user-supplied Markdown files, with a payload combining persona manipulation and a GPTFUZZER-based attack, and evaluated it with 270 prohibited questions spanning nine categories of harm. Under a benign system prompt, the models almost entirely refused, with an average attack success rate of only 0.5%; after injecting the skill file, it rose to 45%. Both obfuscation strategies—an invisible payload based on zero-width characters and a phonetic payload based on grapheme-to-phoneme conversion—did not exceed plaintext injection, and the phonetic variant instead lowered the average success rate to 30%. The authors point out that Markdown skill files are an understudied Agent attack surface, and that vulnerability to configuration-type jailbreaks depends more on the underlying model than on the obfuscation technique.

Related events and news

3 events · 2 news mentions

  • This event's paper

    Markdown技能文件可传播越狱攻击

    研究显示向Agent技能文件注入越狱载荷后,七款开源权重模型平均攻击成功率从0.5%升至45%,个别达68.9%。

News that mentions this paper

Adversa AI 发布 11 月 Agent 技能安全资源汇编

周报:预训练投毒可植入智能体后门

Read originalarxiv.org