Arrow cursor hotspot off by a few pixels
After closer inspection I figured out that the white border of the arrow cursor is not considered part of the cursor, only the black part is, then it seems pixel perfect. It is very confusing to me but I guess its working as intended.