1. An apparatus comprising: logic, the logic at least partially comprising hardware logic, to cause one or more threads executing on a Graphics Processing Unit (GPU) to stop at an instruction level granularity in response to a request to pre-empt the one or more threads, wherein context data of the one or more threads are to be copied to memory in response to completion of the one or more threads at the instruction level granularity.