cloth draped on a mirrored mesh: how to do it properly?
Check your modifier stack. The collision has to be applied after the mirror (and after the armature if you want to move it).

Use the little arrows on your modifier to change its position in the stack.