Mesh freaking out when moving bones
This happens because couple of the vertices has very small weighting to the bones. So avoid this you need to select your mesh, then enter edit mode then select these vertices and set the weighting to 0 for the two bones as shown below:


This will fix the problem as shown below:

Updated .blend file can be found here: