A control device for an internal combustion engine including an upstream cleaning device and a downstream cleaning device that are provided in an exhaust gas passage and a temperature sensor that detects a temperature of exhaust gas between the upstream cleaning device and the downstream cleaning device is provided. The control device includes a first temperature estimating unit configured to estimate a temperature of the downstream cleaning device from the temperature of exhaust gas detected by the temperature sensor and a second temperature estimating unit configured to estimate a temperature of the downstream cleaning device without using the temperature of exhaust gas detected by the temperature sensor. An abnormality determining process for the upstream cleaning device is performed when at least the temperature of the downstream cleaning device estimated by the second temperature estimating unit is equal to or greater than a predetermined threshold value.