How to shut of my iphone 4s
Is it actually rebooting, or failing to shutdown?

You can try a hard reset. Hold both the power button (that you've been using) and the home button in until the device reboots.