Has this online problem been studied before ?
While I'm still not entirely sure what you're looking for, you might try reading Avrim Blum's talk on Online Learning and Prediction, and that might help you focus on areas of interest.