A facility for optimizing machine learning models is described. The facility obtains a description of a machine learning model and a hardware target for the machine learning model. The facility obtains optimization result data from a repository of optimization result data. The facility optimizes the machine learning model for the hardware target based on the optimization result data.