Should hot water heater pipes in the basement be insulated?
I've done it in my basement, otherwise you are just heating the basement, which is typically not conditioned.   You can use the split foam insulation that's preformed, and cover as much as you can.