1. A method for managing a parallel cache hierarchy in a processing unit, the method comprising: receiving an instruction that includes a cache operations modifier that identifies a level of the parallel cache hierarchy in which to cache data associated with the instruction; and implementing a cache replacement policy based on the cache operations modifier.