If you have multiple switches you need to keep in sync you should probably be careful they don't get too far off from each other but removing the ntp server configuration from a switch so you can manually set the time is pretty simple and non-disruptive.
config
(config)# no ntp server ip.of.ntp.server
(config)# end
clock set xx:xx:xx 5 march 2010
are you not able to sync with your ntp source anymore?
Have you tried the ntp sync command?
ntp sync-retry