In one embodiment, a device obtains quality of experience labels for an online application accessible via a network. The device also obtains telemetry data from the network that is associated with quality of experience labels. The device makes, based on the quality of experience labels and telemetry data, a determination as to whether the online application is similar to a second online application for which a prediction model is already available. The device trains, based on the determination, a prediction model for the online application to predict a quality of experience metric for the online application.