Is shimano ct-s500 chain tensioner supposed to move around its bolt?
Yes, no problem. When there's no chain in place it's normal for rear derailers and this type of chain tensioner to be able to rotate like that.