Skip to content
arXiv· arXiv:2202.04479· Muhammad Umer, Robi Polikar·Indexed by this site · Originally published

Imperceptible backdoor triggers induce false memories in continual learning models

False Memory Formation in Continual Learners Through Imperceptible Backdoor Trigger

AI summary

Attackers can inject backdoor samples imperceptible to the human eye during continual learning model training, causing the model to forget specific tasks or classes at test time, forming "false memories." The attack targets generative replay and regularization-based continual learning methods, and is validated as effective on MNIST variants, SVHN, and CIFAR 10. The backdoor pattern can be injected at any time point, and success requires only adding 1% of the total training data of a single possibly unrelated task.

Read originalarxiv.org