I don't know that I'd go for a rubbing compound just for that. There is a product called ScratchX made by Meguiar's that would probably do the trick. You can get it just about anywhere. GS27 is the same stuff, it just costs more $$. Clay would be a great option too. A clay magic kit is like 10 bucks at AutoZone. Any of these measures would most likely fix the problem. I'm not sure about the rubbing compound though. That seems a little too agressive for just some glue stuck to the car. I don't think I'd use that for this problem.