1. An adaptive motion estimation structure, comprising: a first memory block coupled to receive pixels indicative of a reference video frame; a second memory block coupled to receive pixels indicative of a current video frame; a processing block coupled to the first and second memory blocks, the processing block including, a data routing block coupled to receive pixels from the first and second memory blocks, the data routing block adapted to store pixels from the second memory block in accordance with a scheduling map; and an array of processing elements coupled to the data routing block, the array of processing elements receiving pixels from the first and second memory blocks at time intervals defined by the scheduling map; and wherein a programmable configuration of the array of processing elements determines a search pattern used to estimate a difference between the reference and current video frames; and wherein the search pattern is adaptively altered in response to the estimated difference.