Z depth values in OpenEXR do not match the objects in the scene
Blender's depth map should work fine. I have tested it and I do get the right distance.
How do you load the OpenEXR files? Not all OpenEXR readers are reliable. I have noticed that OpenCV can give inaccurate results (see https://github.com/opencv/opencv/issues/10114).