Volume control for chinese lightsaber
For that kind of gadget, it's almost certain that the amplifier is a class D.

Therefore you can simply add a resistor in series with the speaker and this should do the trick. The bigger the resistor the lower the volume. This should not damage the amplifier. Just make sure that you are using a resistor with a decent power rating.