1. A computer-implemented method for caching data being processed in a texture processing pipeline, the method comprising: receiving a memory access request indicating that a data block should be returned from memory; determining that the data block does not reside in a cache unit associated with the texture processing pipeline, wherein the cache unit comprises a plurality of sectors, each sector comprising a plurality of banks; retrieving an encoded version of the data block from a global memory; decoding the encoded version of the data block to produce the data block comprising a height dimension and a width dimension in texels, wherein a data block comprises a texture comprising a plurality of regions, each region comprising a plurality of texels; retrieving a first caching map from a plurality of caching maps based on the height and width dimensions of the data block, wherein the first caching map specifies that adjacent regions of the data block are stored in different sectors of the cache unit and adjacent texels of the data block are stored in different banks of the cache unit; and storing a first texel of the data block at a particular location within the cache unit according to the first caching map.