An image signal processing method includes: receiving an original color filter array (CFA) image and a pixel binned CFA image; computing a specific information of the pixel binned CFA image; and processing the original CFA image according to the specific information. The associated image signal processor includes an input terminal, an operating unit and a processing unit, wherein the input terminal is for receiving an original CFA image and a pixel binned CFA image, the operating unit is for computing a specific information of the pixel binned CFA image, and the processing unit is for processing the original CFA image according to the specific information and utilizing the pixel binned CFA image.