What about the rooms which do not have reservations?
SELECT * FROM rooms WHERE roomid NOT IN  ( SELECT DISTINCT room FROM reservations ) 
rooms which do not have reservations refers to selecting rooms that are not present in the list of rooms that have been reserved;