A method of processing a super resolution image using adaptive preprocessing filtering and/or postprocessing filtering is provided. A provided image processing apparatus may determine a preprocessing filter and a postprocessing filter based on frames included in a reference interval among a plurality of intervals in an input video, may perform filtering on the frames in the reference interval based on the preprocessing filter, may reconstruct a high frequency signal of each of the frames on which the filtering is performed, and may perform filtering on the frames, each having the reconstructed high frequency signal, based on the postprocessing filter.