Object moving on it's own when rendered!
I should have looked at the Graph Editor and the Dope Sheet - after deleting the unwanted keyframes the problem is resolved. 


Thanks atomicbezierslinge and m.ardito for pointing the issue with keyframes.