Origin to geometry does same thing as geometry to origin
I had this same issue as well, with a rigid body world activated.  I had to either move to frame 0 and then set the origin, or I could uncheck the rigid body world and then set the origin, or I could adjust the simulation start of the rigid body world to the same frame as the frame start in my output properties- and then set the origin.
Don't know why the rigid body system does this to the objects but at least there's a solution.