Replacing Halogen with LED bulbs
Key difference:


Halogen lights generally run from AC so this is what your transformer outputs.
LED's require DC so generally yes, you will need a rectified output from your transformer.


I am guessing the transformer is providing enough forward voltage on initial switch-on, but not thereafter.

You may be able to add a rectifier circuit at each bulb location to cope with this.