Try an automotive detailing clay bar (with detailing spray or just some dish detergent in water as a lubricant). It'll work, or not, depending on the adhesion of paint to substrate, but if it works it will solve your problem in minutes.

best,
Evan Ludeman