1. An apparatus comprising a processor and a pipeline memory structure comprising a plurality of hierarchical cache levels including a first cache level and a second cache level, each of the first and second cache levels comprising a volatile cache, a non-volatile filter cache and a non-volatile victim cache, wherein data retrieved from the volatile cache of a selected level as a first cache hit during a data retrieval operation are removed from the volatile cache of the selected level and transferred to the associated non-volatile filter cache of the selected level before a second cache hit to the volatile cache of the selected level, and old data replaced in the volatile cache of the selected level are transferred to the associated non-volatile victim cache of the selected level.