How can I completely remove previous improperly uninstalled CiviVolunteer?
You could try having a look at the volunteer_uninstall.sql file? 

https://github.com/civicrm/org.civicrm.volunteer/blob/master/sql/volunteer_uninstall.sql