Is tensorflow session running in parallel to the rest of my code?
After some research I found out that 'session.run' is not running concurrently to your other code. Indeed, as Ujjwal suggested, the 'tf.data.Dataset' API is the best choice for pipelining batch preprocessing and GPU execution.
I'm running my session on a GPU and I'm wondering if the 'session.run()' piece of code is running in parallel to my other code in my script. 
I use batch processing on the CPU prior to running 'session.run()' in a loop and would like to pipeline this processing with the execution on the GPU. Is this already satisfied in this setting or do I need to manually start threads?