How to silence a 5V electrical beeper/buzzer
It'll be fine if you remove the buzzer and don't do anything else because the buzzer gets a constant voltage. Drawing no current will not change that constant voltage so the rest of the circuit should not be affected.