Camera Glitch movement
So the camera was not changing, the material was. It is hard to see because of the lack of other objects

The Point Density material was set to use Object Space instead of World Space, so it was trying to fit all the particles into the object, and would change the locations of other particles in the point density as needed.