How to upgrade Galaxy Nexus from 4.0.1 to 4.0.4
I think to move to the standard Google build, you have to root your Nexus to bypass the signature verification. Otherwise you can't go to the Google build.
I have a Nexus One and it's the same thing. Before, i can get the Google OTA, i had to root my phone.