Magic mouse 2 always on?
The switch on the bottom is the on-off switch.  The mouse should not move after you turn it off.  If it still moves after you turn it off, it's possible the switch is defective (assuming you're not also touching a trackpad or have another BT mouse connected at the same time).