Pointing direction movement of a fixed camera
As has been noted, the camera, if truly fixed, will point at spot with fixed declination. The RA it points to will be a simple function (namely so many hours and minutes ahead/behind) of the local sidereal time.

Either your camera is not truly fixed (a bit of shake) or (possibly more likely), you have not correctly determined the local sidereal time.