What is the function of a sweep cable?
To keep the wings straight.

If you remove them there is very little to prevent the wing from rotating around the vertical axis. 

All the other cables are attached to the king post or the seat. This cannot provide the leverage needed to counteract the wing yawing relative to the seat.