Aspects of the present disclosure relate to interactive search training. A training canvas comprises results associated with a search query. The training canvas may be used as part of a training session that occurs during normal use of a search platform. When the search platform is first used, the results may be provided based on an existing model. An irrelevant result may be removed from the training canvas, such that a replacement result is added in its place. Additionally, results may be reordered, thereby indicating a ranking with which results should be displayed. Such interactions with the training canvas may be used to generate training data, such that a new model is trained accordingly. Thus, interactions with the training canvas yield high-quality training data that is usable to generate a model having equal or greater performance than a model that was trained using an equivalent amount of implicit training data.