The invention provides an image restoring method, which comprises the following steps: obtaining an image to be restored; dividing the image to be restored into a plurality of regions to be processed; extracting human body unit information from each region to be processed in the plurality of regions to be processed; extracting feature information of a comparison region corresponding to each region to be processed; and carrying out restoring processing on human body units of the regions to be processed according to the human body unit information contained in each region to be processed and the feature information of the comparison region corresponding to each region to be processed. The invention also provides an image restoring system. Real appearance of a shot person in the image can be restored, thereby improving user experience.