What would cause the water pressure to be too high for just a second?
The problem is your expansion tank, or lack thereof. Your home has a check valve somewhere in the system, possibly included with the pressure regulator or as part of the municipal water meter. When your water heater turns on, the heating of the water causes it to expand, and that pressure has nowhere to release until you open a faucet. What you need is an expansion tank installed in your water lines. If you already have one, then it has failed (they usually have a bladder separating the air from the water, and this can fail over time or if not properly maintained). Installing a tank isn't too difficult, but will require shutting off the water to your house, cutting your pipes, and adding a T to your water line. If you have an existing tank, then they are often threaded and are simple to replace (the connection is often threaded and can be screwed off). Note that if you don't fix this, valves in your toilet and other fixtures will start to fail, or the TPR valve on your hot water heater will begin to leak water.