Check that out, impliment it, and then control-F5 (clear your cache entirely so it re-downloads all the images) and try them again They shouldn't flicker.
you could use bg images that include both the on and off buttons then use the bg position spec to control the hover. no flickering since the image is already loaded.