In King of Tokyo when playing with 5-6 players, what happens when monsters die?
Page 2 of the rules, under the Advanced Rules section, answers this question:


  If a monster is eliminated and that brings the number of Monsters below 5, Tokyo Bay can't be occupied anymore. The monster in it must leave Tokyo.


So your guess was correct. You can only occupy Tokyo City once you drop down to 4 Monsters.