Would you have done this pantry construction differently?
Did he build it in place? I would've  built it first, then installed it. That way you know it is squared up. You could use shim to plum and level the pantry. I would have him do it over