1. A device, comprising: a processor and a memory unit; a plurality of connection interfaces; and a cluster manager structured to: remove one or more destination devices, that do not respond within a timeout threshold, from their performance clusters; insert the removed one or more destination devices when the removed one or more destination devices respond to the timeout threshold, until such point as a recent average latency performance merits insertion back into their performance clusters; determine subsets of connections from a set of connections, wherein each connection in each subset has similar performance capabilities with the other connections in the same subset; and detect a change in performance capabilities for one of the plurality of connections and to assign a connection for the one of the plurality of connections to another performance cluster based on the change in performance capabilities.