Call using Facetime audio only
Are you sure you're hitting the 'audio' button correctly? I found that it needs to be tapped very precisely.

Sometimes iOS incorrectly assumes that the tap goes to the whole FaceTime row, which is then highlighted in gray during the tap and starts a FaceTime video call.