How to change Sound device without visiting System Preferences?
To enable the sound icon on the top menu bar, only once you have to go to System Preferences-> Sound-> Show volume in menu bar

alt/option + click on the Sound icon on the menu bar to get this dropdown and select the desired output or input device