How to fix new chain that switches gears when pedaling backwards
I consider it standard practice to replace the rear cogs at the same time as buying a new chain. If you don't the rear cog's teeth start to look like shark fins after a while and your chain will "climb". Esp. when pedaling backwards. 

Edit: worn cogs, even if they don't cause immediate problems, will stretch your chain causing it to wear out quickly.