1. A method for transferring data in an active memory device comprising a three-dimensional memory cube that includes memory divided into three-dimensional blocked regions as memory vaults, one or more memory controllers, and a processing element, the method comprising: fetching and decoding an instruction for execution by the processing element of the active memory device; and based on determining that the instruction is a gather instruction comprising a first source address pointer, a first destination address pointer, a first stride pointer, and a first count, the processing element performing: determining a plurality of source addresses in the memory from which to gather data elements based on the first source address pointer pointing to a list of the source addresses and the first count indicating a number of the source addresses in the list of the source addresses, the plurality of source addresses identifying non-contiguous locations in one or more of the memory vaults; determining a destination address in the memory as pointed to by the first destination address pointer; determining a first stride size vector as pointed to by the first stride pointer, wherein the first stride size vector supports different stride sizes associated with each of the source addresses; accessing the non-contiguous locations in one or more of the memory vaults through the one or more memory controllers in the active memory device as gathered data elements by realizing multiple vector data element accesses simultaneously, wherein the memory vaults each comprise at least one data element from each of a plurality of memory layers; and transferring the gathered data elements from the plurality of source addresses to contiguous locations in the memory starting at the destination address and incrementing the destination address based on the first stride size vector as each of the gathered data elements is transferred; and based on determining that the instruction is a scatter instruction comprising a second source address pointer, a second destination address pointer, a second stride pointer, and a second count: determining a source address in the memory from which to read a plurality of data elements at contiguous locations as pointed to by the second source address pointer; determining a plurality of destination addresses in the memory to store the data elements at non-contiguous locations based on the second destination address pointer pointing to a list of the destination addresses and the second count indicating a number of the destination addresses in the list of the destination addresses; determining a second stride size vector as pointed to by the second stride pointer, wherein the second stride size vector supports different stride sizes associated with the source address; identifying filter criteria associated with the instruction; and transferring one or more of the data elements from the source address to the destination addresses while applying the filter criteria to limit transferring between the source and destination addresses according to the filter criteria based on a data value of the one or more of data elements to be transferred, wherein the filter criteria prevent one or more excluded data values from being stored at the destination addresses while continuing to store one or more included data values at the destination addresses and incrementing the source address based on the second stride size vector regardless of the filter criteria; wherein the processing element provides virtual address computation functionality that supports an execution of the gather instruction or the scatter instruction.