1. A method of managing processing of long tail task sequences in a stream processing framework, the method including: operating a computing grid that includes a plurality of physical threads which processes data from one or more near real-time (NRT) data streams for multiple task sequences; queuing data from the NRT data streams as batches in multiple pipelines using a grid-coordinator that controls dispatch of the batches to the physical threads; assigning a priority-level to each of the pipelines using a grid-scheduler, wherein the grid-scheduler initiates execution of a first number of batches from a first pipeline before execution of a second number of batches from a second pipeline, responsive to respective priority levels of the first and second pipelines; detecting that at least one NRT data stream for a long tail task sequence is emitting measurably less data than before; and migrating the NRT data stream for the long tail task sequence to a pipeline with low-priority.