Unpinning Cloth Deforms Object
Disabling Group on the way (of running simulation) is like to change the rules of game in a middle of match (shocked audience). 


Let Group Remove enabled
and animate Remove Treshold parametr 


by adding first keyframe on a frame were pin group should still affect cloth with value 0, second keyframe on a frame were pin group should stop affect cloth with value 1.