Why does the play store show "deactivate" instead of uninstall
This is probably because you have configured Outlook as a Device Administrator. This prevents you from uninstalling the app. If you wish to uninstall Outlook you will need to go to Settings > Security > Device Administrators and uncheck Outlook. This will then allow you to uninstall the app.

Steps taken from Nexus 5 so may differ slightly on other devices