mpi "message passing interfaceenables parallel processes to communicate efficiently commonly one process will be "controllerand manage worker processes inherent support for scaser--gather operacons mpi is well--supported on our clusters mpi py interfaces to mpi from inside python caveat for mpi gurusnumpy does not have distributed arrays yetcomplicates some algorithms