title: OpenVINO unable to get optimum performance while running multiple inference engines
body: <p>I am running multiple python processes( 4 in this case using multiprocessing module) for person detection (using ssd mobilenet model), each having it's own inference engine of OpenVINO. I am getting a very low FPS (not more than 10) for each process.  My suspicion is the CPUs are not getting utilized optimally because the number of threads being spawned by each engine are high, which is adding to the overhead and also the sharing of CPUs across processes.<br>
  Also for single process, I am getting upto 60fps with OMP_NUM_THREADS set to 4.  </p>
  
  <pre><code>My CPU details are:-
  2 Sockets 
  4 cores each socket 
  1 thread each core 
  Total - 8 CPUs
  </code></pre>
  
  <p>So what would be the</p>
  
  <ol>
  <li>Optimal value for OMP_NUM_THREADS in this case? </li>
  <li>How can I avoid Sharing of CPUs across each process?</li>
  </ol>
  
  <p>Currently I am playing with OMP_NUM_THREADS and KMP_AFFINITY variables, but just doing a hit and trail on setting the values. Any detail on how to set would be really helpful. Thanks</p>