title: why we are using strategy.num_replicas_in_sync
body: <p>Can anybody tell me the function of the below code? I know it is used with batch size but what is it exactly calculating. Can anybody tell me, please?</p>
  <pre><code>BATCH_SIZE = 8* strategy.num_replicas_in_sync
  </code></pre>