title: Training Keras continuously vs single iterations
body: <p>Is there any difference between training Keras models once for 64 epochs of 64 times for one epoch. <br>
  How do gradients work in this case? How do they keep the history of previews operations in order to adjust momentum?</p>
  
  <p>1)</p>
  
  <pre><code>model.fit(X, y, batch_size=64, epochs=64, verbose=False)
  </code></pre>
  
  <p>2)</p>
  
  <pre><code>for i in range(64):
      verbose = (i % 16) == 0
      if verbose:
         print(i, end='')
      model.fit(X, y, batch_size=64, epochs=1, verbose=verbose)
  </code></pre>