Compute normal of anFPoly. Works even ifFPolyhas 180-degree-angled sides (which are often created during T-joint elimination). Returns nonzero result (plus sets normal vector to zero) if a problem occurs.