Why can't I use data augmentation with a pretrained convnet?
Found the answer in stats.stackexchange.com. Hopefully this helps anyone else with the same question.

feature extraction: freezing convolutional base vs. training on extracted features