Multiple layers, master pivot point
I have figured it out.

In object mode you can create an "Empty" and put all the other layers inside the Empty, Unity3D will use the pivot point of the Empty because it is the outermost layer.

All you have to do is position the pivot point in the Empty.