Charging a 9volt battery with a jst or dc plug
Your plan should be fine provided you use a hot iron and work quickly -- the battery holder should provide enough heatsinking to keep the battery from being too unhappy under those circumstances.  Feel free to remove the battery during the soldering process if you feel that'd be safer, though.