A method and an image processing apparatus for image visibility restoration are provided. The method includes the following steps. After an incoming hazy image is received, each of the incoming pixels is classified as either belonging to a localized light region or a non-localized light region. The localized light region is partitioned into patches according to each patch size in associated with image sizes in a training data set. Localized light patches are determined based on a FLD model and a designated patch size is accordingly determined. Adaptive chromatic parameters and dual dark channel priors corresponding to the designated patch size and a small patch size are determined. The incoming hazy image is restored according to the adaptive chromatic parameters, atmospheric light and a transmission map determined based on the dual dark channel priors to produce and output a de-hazed image.