The easiest thing to do is take your new router and change the WiFi SSID and password to the same one you had with the old router. This way, you will not have to reconnect any devices again. Instead, ALL your devices will connect to the new WiFi router as if it was the old one.
Otherwise, follow the instructions here starting with Step 3:
https://www.coralvuehydros.com/product-support/icecap-dual-pump-controller/connect-to-your-wifi-network-bluetooth/