title: How to compensate if I cant do a large batch size in neural network
body: <p>I am trying to run an action recognition code from GitHub. The original code used a batch size of 128 with 4 GPUS. I only have two gpus so I cannot match their bacth size number. Is there anyway I can compensate this difference in batch. I saw somewhere that iter_size might compensate according to a formula <code>effective_batchsize= batch_size*iter_size*n_gpu</code>. what is iter_size in this formula?
  I am using PYthorch not Caffe.</p>