Float Latency (ms)
  <td class="tg-0pky">Quantized Latency (ms)</td>
  <td class="tg-0pky">Inference Performance Gain</td>
  <td class="tg-0pky">Device</td>
  <td class="tg-0pky">Notes</td>
</tr>
<tr>
  <td class="tg-lboi">BERT</td>
  <td class="tg-lboi">581</td>
  <td class="tg-lboi">313</td>
  <td class="tg-lboi">1.8x</td>
  <td class="tg-lboi">Xeon-D2191 (1.6GHz)</td>
  <td class="tg-lboi">Batch size = 1, Maximum sequence length= 128, Single thread, x86-64, Dynamic quantization</td>
</tr>
<tr>
  <td class="tg-lboi">Resnet-50</td>
  <td class="tg-lboi">214</td>
  <td class="tg-lboi">103</td>
  <td class="tg-lboi">2x</td>
  <td class="tg-lboi">Xeon-D2191 (1.6GHz)</td>
  <td class="tg-lboi">Single thread, x86-64, Static quantization</td>
</tr>
<tr>
  <td class="tg-lboi">Mobilenet-v2</td>
  <td class="tg-lboi">97</td>
  <td class="tg-lboi">17</td>
