Only show the cart block if it contains items
Here is the solution. Add these lines in template.php file of a theme you`re using. Change THEMENAME on the name of your theme.

function THEMENAME_commerce_cart_empty_block() {
  return '';
}