1. A method, with an accelerator system in an out-of-order processing environment, for prefetching data from a server system in the out-of-order processing environment, the method comprising: receiving, from an application on at least one of the server system and a user client, a plurality of prefetch requests associated with one or more given data sets residing on the server system; storing each prefetch request in a prefetch request queue; assigning a score to each prefetch request; selecting a set of the prefetch requests from the prefetch queue that comprise a score above a given threshold; and prefetching, for each prefetch request in the set of prefetch requests, a set of data from the server system that satisfies each prefetch request, respectively.