What is the small microphone icon floating on top of the screen in macOS and how do I turn it off?
This microphone floating on your screen IS NOT the dictation feature. It is the Voice Control. 


Go to System Preferences > Accessibility 
Scroll down until you see "Voice Control"
Disable Voice Control.