The disclosure provides a method for optimizing remote display at a client device in communication with a remote desktop. The method generally includes receiving one or more frames for display at the client device, determining that a frame rate of the received one or more frames is less than an expected frame rate and/or a resolution of the received one or more frames is less than an expected resolution, determining that at least one of a local central processing unit (CPU) usage at the client device is less than a CPU usage threshold or a local graphics processing unit (GPU) usage at the client device is less than a GPU usage threshold, applying one or more enhancement techniques to the received one or more frames to produce one or more optimized frames while continuously monitoring the local CPU usage and/or the local GPU usage at the client device, and rendering the one or more optimized frames for display at the client device.