1. A system comprising: a plurality of processors; and a multi-level memory hierarchy; wherein a first processor of the plurality of processors is configured to: detect a miss for a memory request in a first memory; and utilize a membership query mechanism for determining if data targeted by the memory request is stored in a second memory; wherein: the membership query mechanism is a two-level bloom filter; a plurality of hash bits are generated for an address of the memory request; a first portion of the plurality of hash bits are used to select a word within the first and second portions of the bloom filter; and a second portion of the plurality of hash bits are used to select individual bits within the selected words of the first and second portions of the bloom filter; wherein the system is configured to: store the first portion of the membership query mechanism in the first memory; and store the second portion of the membership query mechanism in the second memory.