1. A method for managing a parallel cache hierarchy in a processing unit, the method comprising: receiving an instruction from a scheduler unit, wherein the instruction comprises a load instruction or a store instruction; determining that the instruction includes a cache operations modifier that identifies a policy for caching data associated with the instruction at one or more levels of the parallel cache hierarchy; and executing the instruction and caching the data associated with the instruction based on the cache operations modifier.