Why does my transistor circuit produce a wave?
Maybe your circuit is rather amplifing than generating an oscillation.

This can happen if the "unconnected" base is picking up some stray fields (e.g. radio signal  or fields generated by a switching power supply, etc.) 

Since you are using a solderless breadboard, the base is probably connected to a line than can act as an antenna.