Self collision breaks or "shrinks" the cloth if the mesh has dense polycount
Done, Rich Sedman answer what i needed to know in this post Self Collision - Blender Cloth Sim shrinks mesh anyway i still hate that the self collision distance and object distance cant be lower than 0.001...