1. A method for managing data storage for query processing in a network environment, the method being implemented by one or more processors and comprising: (a) maintaining a metadata representation of a logical data structure that is queryable by entities of the network environment, the logical data structure spanning a first set of logical partitions on a first tier of memory resources and a second set of logical partitions on a second tier of memory resources, the logical data structure being optimized to store data for responses to queries in the first tier of memory resources; (b) detecting a condition or event for providing data stored with the second tier of memory resources in response to queries; and (c) in response to detecting the condition or event, transferring data from the second tier of memory resources to the first tier of memory resources.