Resource utilization can be intelligently managed in desktop virtualization environments. Utilization of client and server resources can be tracked during sessions that are established to access desktops. Machine learning models can be applied to the client and server resource utilization to create policies that define configuration settings for dynamically optimizing sessions based on the current utilization of resources during the sessions.