Change own phone number in ICS
In previous versions of Android (mine is 2.3.7) you can set this setting in the Additional call settings. In Android 4.0 the Additional call settings screen is located here:

Open the Phone app -> [Menu] -> Settings -> Additional settings.

I have not verified this on a physical device yet.