It would be easier for right handed people to do this with their right hand so they would need to wear the watch on their left wrist (unless they took it off). Working the buttons on a digital watch would also be easier with the right hand (for right handed people) but the precedent was set long ago.