A display apparatus is provided. The display apparatus includes an input interface, a first storage, a display, and a processor. Pixel values corresponding to a predetermined number of lines in an image input through the input interface are stored in the first storage,. The processor acquires a first patch of a predetermined size by sampling a number of pixel values located in an outer region of a matrix centering about a specific pixel value from among the pixel values stored in the first storage, acquires a high-frequency component for the specific pixel value based on the acquired first patch, and processes the input image based on the high-frequency component. The display displays the processed image.