How to capture territories with no numbers printed on them?
Correct. A Japanese marker is placed on it as it is a captured territory by the enemy and should be treated as such by the allies. 

I.e. allies can't land on it without taking it, it can't be blitzed through it without battling units in it etc. 

Simply up it just had no IPC value.