One of the biggest differences Between Cuda, and, MPl, is that MPI has a distributed memory model among all the MPI processes. what that means is that, You can no longer have a global memory data structure. 