1. A runtime system comprising multiple execution threads, wherein each execution thread is configured to perform one or more of the following functions: causing an application to issue one or more operation requests; scheduling processing of the operation requests; dynamically preparing one or more compute kernels for the operation requests; dynamically executing the compute kernels on one or more processing elements of a parallel-processing computer system; and dynamically managing the compute kernels' memory usage of the processing elements.