I cannot stop my Google contact addresses from displaying in Maps
The setting you are talking about will only remove contacts from showing up in the actual map.

To remove contacts from showing in my places tab, do the following:

settings  &rarr; Google  &rarr; [general]  &rarr;
Personal info &amp; privacy  &rarr; Activity controls  &rarr; Web &amp; App Activity  &rarr; Turn "Web &amp; App Activity" off