1. A system comprising: a processing device configured to: select an accelerator template from a plurality of accelerator templates based on an analysis of a database query, wherein each of the plurality of templates represent different stored processing configurations that the accelerator are capable of executing and wherein each of the plurality of accelerator templates includes a plurality of pipelined acceleration modules arranged on an integrated hardware device in a feed-forward pipelined fashion, such that each of the different acceleration modules can have different data processing rates; and execute at least a portion of the database query according to the accelerator template, wherein during the execution of the at least a portion of the database query on the accelerator, the accelerator manages a pulling of input data from a host device and returning an output data to the host device.