most of them had been captured in places such as singapore , burma and malaya during japan 's initial victories after pearl harbor and had spent the vast majority of their time in the military in captivity .