Why drupal includes *.profile file on every page?
This is a new feature of Drupal 7: install profiles behave like modules.

See #509398 : Install profiles should be modules with full access to the Drupal API and all it entails

Code that you don't want loaded during run-time should be moved to hook_install().

Edit - Xio asked about uninstalling a profile.
variable_set('profile', 'standard');
might work.