Using TensorFlow's preexistent Inception labeler I know I can retrain Inception to label images, but can I just provide an image to a non retrained Inception and get a label back?
Yes, but the labels are limited to the ones from ImageNet.