If the paint comes off that easy it doesn't sound like a very good paint job. You might have to just note the bullet and do it properly now.