Yes, you need to login to each AP and change the pre-shared key configured under SSID configuration.
From end devices, you may need to forget that SSID and connect it fresh (in case previous password is cached within the device)
HTH
Rasika
*** Pls rate all useful responses ***