If I want to enable the web page on all my cisco phones, can I do this under the enterprise phone configuration and just tick the box?
Yes you can enable it Enterprise phone Configurations
will this cause any issues? will I need to do it out of hours? will it reset the phones?
Never faced any issues. Since you You need to restart the TFTP service and restart all the phones better to do it Out of Hours.