Completely "Mute" my Android Phone?
After exploring a little more, I found this solution:


Click your device "home" button;
Tap "Settings";
Tap "Sound";
Tap "Vibrate";
Select either "Never" or "Only when not in Silent mode".


That's it!