The disclosure herein describes a server-side system that dynamically enhances user experience on a remoting client device. During operation, the system monitors user inputs on the client device. When a user input involving a predetermined interaction between the user and the GUI on the client device is detected, the system alters parameters of frame encoding based on the user interaction. Frame updates transmitted to the client device during the user interaction are encoded with the altered encoding method to improve user experience. Once the user interaction is ended, the system reverts back to the normal encoding method.