Remove unnecessary flags from XLA ARM build now that hermetic Python has landed
Remove unnecessary flags from XLA ARM build now that hermetic Python has landed

In a followup I will check the disabled ARM tests to see which can be reenabled after this change.
