1. A method of generating a local graphical user interface (GUI) on a touch screen of a client device that is connected to a server device having a remote desktop, the method comprising: receiving, from the server device, user interface (UI) metadata that specifies content of a context menu in the remote desktop, and a base image comprising a graphical representation of the remote desktop; generating, at the client device, a native context menu GUI element based on received UI metadata, wherein the native context menu GUI element comprises a virtual representation corresponding to the context menu of the remote desktop; generating a local GUI to be displayed on the touch screen of the client device, the local GUI comprising the base image received from the server device and the native context menu GUI element; and responsive to detecting that the native context menu GUI element has been manipulated through a touch input, transmitting, to the server device, an input event indicating a manipulation of the context menu in the remote desktop.