TensorFlow lightweight for prediction
I think the only way yo use TF in a lightweight mode is using TFlite or TFLite Micro. For this to work yo need to convert your frozen inference graph to a .tflite file.
Is there anyway to install a lightweight version of TensorFlow for prediction only?
I built a Docker image with TensorFlow 2.5 and python 3.8 slim. The image size is 1.8Gb but I need it to be 1Gb maximum.
As I will only use this Docker image for prediction, I guess there must be a way to reduce TensorFlow and install only the needed modules.
If you know if TF lite or TF serving can help me to reach this out, please tell me how.