1. A rack server system for a packet processing, comprising: a plurality of servers mountable in a rack; a top of rack (TOR) unit having connections to each of the servers; a plurality of offload processor modules, each offload processor module having at least one input-output (IO) port and multiple offload processors, including at least a first offload processor module connected directly to a second offload processor module through their respective IO ports, the offload processor modules are connected to a memory bus on each of the servers, and are further configured to receive network packets from the server through the memory bus and from the IO port on the offload processing module; and a memory controller configured to send network packet data directly to at least one offload processor module via the memory bus to which the offload processor module is attached.