title: How to clean/reinitialize Keras resources/network? How to restart training from scratch?
body: <p>I am training the same network against the same sizes of data but with different augmentation in order to find better augmentation policies.</p>
  
  <p>Unfortunately, after a lot of iterations, I am getting out of memory error.</p>
  
  <p>It looks like resorces are not freed on cycles.</p>
  
  <p>I tried to assign <code>None</code> to model then call <code>gc.collect()</code> -- this didn't helped.</p>
  
  <p>Also I tried to call <code>backend.clearsession()</code> -- this also didn't helped.</p>
  
  <p>Is there any conventional method to restart training from scratch in Keras?</p>