Modifying HTML of menus
I'm not sure if there are template hints that work exactly with this, but you can place block.tpl.php and region.tpl.php (in modules/block/ and modules/system/ respectively) in the theme directory, and then use conditions to sort through which areas you want to be marked up the default way and regions you don't want to be marked up that much.