Switch to Desktop shortcut bug (desktop 2 and desktop 3 are mixed)
Is Mission Control set to automatically rearrange your spaces based on most recent use? That might trigger the behaviour you see in certain circumstances. Check System Preferences -> Mission Control and that the highlighted checkbox is unchecked.