title: How to restore weights of Inception V3 and retrain only the last layer?
body: <p>I have followed this tutorial (<a href="https://codelabs.developers.google.com/codelabs/tensorflow-for-poets/#1" rel="nofollow noreferrer">https://codelabs.developers.google.com/codelabs/tensorflow-for-poets/#1</a>) successfully. I have trained on my own data and that works. However now I want to continue training on the last layer that I have spent a day training. However when I simply rerun the command </p>
  
  <pre><code>python -m scripts.retrain \
    --bottleneck_dir=tf_files/bottlenecks \
    --how_many_training_steps=500 \
    --model_dir=tf_files/models/ \
    --summaries_dir=tf_files/training_summaries/"${ARCHITECTURE}" \
    --output_graph=tf_files/retrained_graph.pb \
    --output_labels=tf_files/retrained_labels.txt \
    --architecture="${ARCHITECTURE}" \
    --image_dir=tf_files/flower_photos
  </code></pre>
  
  <p>the training starts back at 0. </p>
  
  <p>I want to do this, because I wish to adjust the learning rate as learning continues (and potentially other values aswell)</p>
  
  <p>In particular the retrain.py file (<a href="https://github.com/googlecodelabs/tensorflow-for-poets-2/tree/master/scripts" rel="nofollow noreferrer">https://github.com/googlecodelabs/tensorflow-for-poets-2/tree/master/scripts</a>) is interesting. I also tried to copy the some code from label_image.py into retrain.py, but with no success. </p>