apply cloth with different body
Have you tried simulating the cloth object as "cloth" in the Physics panel? It'll make the object behave like real cloth. Set the cloth as "cloth" and the body as "collision", and press the "Play" button in the timeframe, and it should go well.