To form these closure domains with "sideways" magnetization requires additional energy due to the aforementioned two factors.
However, the domains can also exist in other configurations in which their magnetization mostly points in the same direction, creating an external magnetic field.