Override contrib module's theme
Copy commerce-cart-block.tpl.php file to your theme and edit that copy. Remember to clear your cache before you reload the page. That's all. Don't rename. Don't play with suggestions.