Train building classifier for imagerial data
This blog article might be a good starting point. From what you described and depending on your data, semantic segmentation might be overkill and classification will suffice.

Either way, the first step will be to get your hands on training data. If you do not have labels already, this might mean that you have to sit down for a while an label a bunch of images. This is much easier for classification than segmentation, but the information you end up with is not as rich.

For segmentation you should then check out U-Net or DeepLabv3. Classification is not my strong site, but VGG or a ResNet should do the trick.