Tracking: Object Solver not following tracks (with file)
I think I got it working: http://pasteall.org/blend/index.php?id=52943

The key for aligning the "Tracks" mesh from the 3D Markers To Mesh operator is to add the object solver, choose tracking object and tracking camera, and then hit "Set Inverse". After that it should be lined up fine.

I deleted everything before in order to start from scratch. 

Not sure how you setup your camera solution, but I used Tripod solving, as there is nearly no movement at all, so tracking only rotation should be enough. And when you do Tripod, you don't need so many markers. A handful is usually enough.
When you do the Object Solve you have to turn off Tripod of course. 

What made the file behave a bit weird for me was not having the footage, so I was a bit confused which resolution to use. Using 256x256 seems to work though. Seems that when you solve and no footage is present Blender screws up the solve, as it tries to apply a square aspect ratio to the original resolution or something like that. 

In fact, if you are only after the object's motion, you do not need a camera track at all. Simply ignore the camera motion and add an additional "object" in the clip editor so you can solve the object motion.