Cloth simulation on human distance
Cloth Distance

possible issue of big distance can be object Scale - try Apply scale Ctrl+A for both objects.

adjust distance for &quot;body&quot; object
Physics Properties &gt; Collision &gt; Soft Body &amp; Cloth &gt; Thickness Outer



Collision ignorance

you have to extend cache End frame of Cloth sim
also motion of hands is too drastical (from frame to frame) cloth has no time to react
if issue persists even for slower motion try to increase Quality Step and Collision Quality