title: cuda device selection with multiple cpu threads
body: <p>Can you tell me how cuda runtime chooses GPU device if 2 or more host threads use cuda runtime?</p>
  
  <p>does the runtime choose separate GPU devices for each thread?</p>
  
  <p>does GPU device needs to be set explicitly?</p>
  
  <p>Thanks</p>