I have to remove HTML code that shows up on each page, where is it coming from?
It's probably your theme files then, in /sites/all/themes/[selected theme]. You can also try to change the theme and check if it is gone.

Have a look at html.tpl.php and page.tpl.php files.