Does this Arboretum Rooftop Building exist?
The actual rooftop garden does not seem to exist, but there is a likely model for this building, which is located northwest of this temple.



It seems to be a private building this is a school that teaches Ikebana/華道. It's likely this rooftop area is not open to the public. This seems to be the closest match to the building depicted in the anime.