hash-based shuffle data is simply stored as one file per block . this logic is from fileshuffleblockresolver . concode_field_sep Executor directoryCleaner concode_elem_sep String appId concode_elem_sep ConcurrentMap<AppExecId,ExecutorShuffleInfo> executors concode_elem_sep TransportConf conf concode_elem_sep Logger logger concode_elem_sep String execId concode_field_sep int hashCode concode_elem_sep void registerExecutor concode_elem_sep ManagedBuffer getBlockData concode_elem_sep void applicationRemoved concode_elem_sep boolean equals concode_elem_sep String toString concode_elem_sep void deleteExecutorDirs concode_elem_sep ManagedBuffer getSortBasedShuffleBlockData concode_elem_sep File getFile
ManagedBuffer function ( ExecutorShuffleInfo arg0 , String arg1 ) { File loc0 = getFile ( arg0 . localDirs , arg0 . subDirsPerLocalDir , arg1 ) ; return new FileSegmentManagedBuffer ( conf , loc0 , 0 , loc0 . length ( ) ) ; }