Altium room on PCB layout after ECO
You should just change your ECO generation options to not automatically create them if you're not using them:



Otherwise to remove the rooms, yes, you can just select them in the PCB Editor and delete them.