How to change wifi credentials of multiple ESP8266 together
you can reconfigure your router, or whatever network mode you are using, with auto-login to the MAC addresses of your ESPs.
And then if you provide the MACs of the corresponding ESPs, and change your WiFi credentials, then you don't need to configure the ESPs individually. It will auto-connect itself.