How can I fix this uv unwrapping issue?
There are not enough seam cuts, you really have to think like you're cutting the shirt with scissors, otherwise Blender can't properly unfold the mesh. If you add some additional seams on the shoulder and on the sides it will map properly.