1. A method for executing interactive application by at least one interactive application host of an interactive application host center, wherein the interactive application is under the control of at least one client that along with an optional collection of clients receives via broadband network, frame stream or video of the interactive application rendered by the interactive application host center, said method comprising, sending graphics command and/or graphics data of the interactive application via inter-connect networks to at least one graphics rendering apparatus that is assigned to process the interactive application's graphics rendering wherein said graphics rendering apparatus comprising multiple graphics processing elements, at least one graphics data cache, and a means of dispatching graphics commands to graphics processing elements for concurrently rendering frames of multiple interactive applications; querying whether the graphics data is currently cached in the graphics rendering apparatus; sending the graphics data to the graphics rendering apparatus if the graphics rendering apparatus does not have a copy of the graphics data, or allowing the graphics command to share the graphics data that is cached in the graphics rendering apparatus; and rendering frames or video of the interactive application on off-screen frame buffer by the graphics rendering apparatus according to the graphics command and/or the graphics data.