Why does my oven temperature keep rising?
The thermocouple insures that the flame is on, it's used to shut the gas off if the flame goes out.  Your problem sounds more like a thermostat.  The thermostat measures the temperature of the oven, and is used to determine when to turn the flame on and off.  Check the manufactures documentation for thermostat troubleshooting and replacement information.

Components in the range could have been damaged while being moved, if the range was not handled with care.