To which side should a bi-fold door open?
The answer is, it depends which side of the door is the "public" side so to speak. 

The door should be pull from the side that you open it from most often so you can use the handles.

It is hard to tell from your images, but I'm thinking the door leads to some sort of storage area so option 1 would be the best choice since you will open/close it from that side.

Remember also... Bi-Fold doors are really hard to close from the back-side without doing something weird to them to give you something to grip in the middle (as you have shown).... They are really not meant to be used as bi-directionally closable doors.

UPDATE

Clearing the rabbit hole.

In order to clear the rabbit and jamb, you need to move the pivot point a little further in. Moving the pivot points further in will allow the door to centre outside the jam when open as shown below. You may have to "Maguiver" the bottom bracket a bit if it does not let you go out that far. Remember when calculating the distance to the hole in the door to include space to allow the door to pivot. 

The pin at the top on the other side of the door should be the same distance from the central door hinge as the pivot point hole.



With the swing the way you want it you would need to move the door out of the rabbit and add a piece of trim to the rabbit to create a new facia like below.



Personally. I's save myself a lot of fuss and bother and not use bifold-doors. I'd switch to the more modern French-door style.