title: Does tensorflow-serving supports multi-threading?
body: <p>I have some problem with using tensorflow serving.</p>
  
  <p>I deployed my tensorflow model as RESTful APIs using tensorflow serving. But I doubt if tf-serving server supports multi-threading. I've done some experiments and it does not seem to be.</p>
  
  <p>I also noticed that there is <code>--tensorflow_session_parallelism</code> option for tensorflow_model_server, but using the option makes my server more slow..</p>
  
  <p>Is there any reference for using tensorflow serving with multi-threading?</p>