title: Should we reuse the cublasHandle_t across different calls?
body: <p>I'm using the latest version CUDA 5.5 and the new CUBLAS has a stateful taste where every function needs a <code>cublasHandle_t</code> e.g.</p>
  
  <pre><code>  cublasHandle_t handle;
    cublasCreate_v2(&amp;handle);
    cublasDgemm_v2(handle, A_trans, B_trans, m, n, k, &amp;alpha, d_A, lda, d_B, ldb, &amp;beta, d_C, ldc);
    cublasDestroy_v2(handle);
  </code></pre>
  
  <p>Is it a good practice to reuse this handle instance as much as possible like some sort of a <code>Session</code> or the performance impact would be so small that it makes more sense to lower code complexity by having short-living handle instances and therefore create/destroy it continuously?</p>