Normally, during inference the images are resized to 520 pixels. An optional speed optimization is to construct a Low Res configuration of the model by using the High-Res pre-trained weights and reducing the inference resizing to 320 pixels. This will improve the CPU execution times by roughly 60% while sacrificing a couple of mIoU points. The detailed numbers of this optimization can be found on the table below:



Low-Res Configuration
mIoU Difference
Speed Improvement
mIoU
Global Pixel Acc
Inference on CPU (sec)




LR-ASPP MobileNetV3-Large
-2.1
65.26%
55.8
90.3
0.1139


