An image diagnosis supporting device includes a model reader that reads an image diagnostic model that outputs a diagnostic result for a diagnostic image that is an input medical image, a storage unit that stores facility data that is a plurality of medical images associated with diagnostic results held in a facility, and an adjuster that adjusts, based on the facility data, the image diagnostic model or the diagnostic image input to the image diagnostic model.