Motion tracking round objects I'm kind of new to motion tracking, and I need some help. I'm trying to replace the face on some footage of a LEGO minifigure. (You can see the footage in the GIF below):

So, I added tracking markers to the eyes and mouth of my minifigure, and tracked them. When I go to Reconstruction>Link Empty to Track, it makes empties in my 3D view. They look fine from the camera angle, but in 3D space, all of the empties are lined up throughout the entire frame sequence, they just wobble around instead of move in 3D space.



Since they don't move in 3D space, my new 3D face I am trying to add will not rotate with the head, instead, it just sticks there.



So, my question is, what do I need to do to do this? The face needs to rotate. The backface culling will take care of the other side of it so it isn't seen, but my tracking markers are not moving correctly, so it ruins the entire thing.

Thanks for the help in advance! =D
As cegaton mentioned your current solution does not represent 3d space, because you don't have enough trackers. You can try the following workflow:


First enable object tracking 





Try to track the head with 8-14 markers
Increase the search area of the markers, if the footage is jumpy 
Solve your object track with a value bellow 0.6
Apply a camera solver constraint to the scene camera without solving it, this  should show your object solution (calculated empties) in the viewport





Align your new face geometry to the empties (trackers) or use the trackers to pointcloud function to reconstruct the head  
Apply an object solver constraint to the new geometry 




Now your object hopefully should move properly with the empties.