1. A method for adapting to changes in captured camera images in an interactive video display system, the method comprising: developing a slow-changing background model and a fast-changing background model, each of the background models based in part on trends in the captured camera images, the models developed at a computing device; detecting a background change in one or more of the captured camera images with respect to the slow-changing background model, the background changed captured by a camera; determining that the background change exceeds a threshold associated with the slow-changing background model, the determination made by the computing device; and generating a vision image using the fast-changing background model as a result of the background change exceeding the threshold, the vision image rendered on a video display.