An image defect correction apparatus capable of satisfactorily correcting a white vertical line caused by point defects on the same vertical CCD. A first correction value is determined from a difference between an average value of luminance signals obtained by a vertical CCD including one or more point defects and an average value of luminance signals obtained by the vertical CCDs when light-receiving elements face a predetermined ineffective signal region. It is determined to which of regions divided by Y addresses of point defects on the same vertical CCD each of Y-directional positions of luminance signals outputted from a horizontal CCD is positioned. The first correction value is multiplied by a predetermined coefficient corresponding to the determined region to calculate a second correction value with which the luminance signals from the horizontal CCD are corrected.