Payment currency not allowed
Solution from Craft: 


  In your Control Panel, click on Commerce then on the vertical subnav (where you have All Orders, New, Shipped....) you will have Active and Inactive carts, this is what Luke suggested you clear.


Essentially, it looks like existing carts may exist which are still using the old currency. Therefore these must be cleared before changing default currency.