Any process that stops, prevents or reduces the frequency, rate or extent of asymmetric protein localization involved in cell fate determination.
down regulation of asymmetric protein localization involved in cell fate commitment