I like Jeff's idea. But what I've done a few times was to remove the bolt, touch up the paint and while wet, tight the bolt. In other areas, I've cut up a milk carton to washer size needed and used it between the paint and the 'offending' part of the fastener.