A method for creating an interpretable model for healthcare predictions includes training, by a deep learning processor, a neural network to predict health information by providing training data, including multiple combinations of measured or observed health metrics and corresponding medical results, to the neural network. The method also includes determining, by the deep learning processor and using the neural network, prediction data including predicted results for the measured or observed health metrics for each of the multiple combinations of the measured or observed health metrics based on the training data. The method also includes training, by the deep learning processor or a learning processor, an interpretable machine learning model to make similar predictions as the neural network by providing mimic data, including combinations of the measured or observed health metrics and corresponding predicted results of the prediction data, to the interpretable machine learning model.