How to remove taxes if outside EU
You have three options:

1) Apply the patch from https://drupal.org/node/1240216. It will give you a rules action that will remove the tax.

2) Always enter product prices without tax, then the VAT rules can just be made conditional based on the customer address.

3) Use commerce_vat (and commerce_eu_vat).

The first one is probably your easiest way out at this point.