1. Apparatus for implementing B-picture scene changes comprising: a prediction stage for predicting a B-picture scene change based upon a sequence of statistical information in an encoder order; said encoder order including an input video sequence in an order in which the encoder codes the video frames and said encoder order being different from an order in which video frames are displayed during playback; said prediction stage calculating picture values using a luminance value and a chrominance value and identifying a history of changes in said input video sequence in said encoder order; and comparing a current image with a past reference image and a future reference image; said prediction stage identifying first differences between said current image and said past reference image, and identifying second differences between said current image and said future reference image; said prediction stage identifying minimum differences between said identified first and second differences; and comparing said identified minimum differences with a scene change threshold value to predict said B-picture scene change; and a reaction stage responsive to the prediction stage predicting said B-picture scene change for modifying a quantization scale of a rate control algorithm.