Cloth repels and glitches through object
try this file... maybe you get some hints


I tried to separate well the unpinned geometry (exagerating a bit but...) and subdivided also the hair so they get a better cloth structure