In a method of filling a hole in a virtual view image warped from a two-dimensional image, the hole is detected to determine the number of pixels in the hole and to obtain position information corresponding to the hole. For each pixel in the hole, a target image block containing at least a corresponding pixel in the hole, and search image blocks corresponding to the target image block are selected from the virtual view image. Central pixels of the search image blocks are disposed on the upside, downside, right and left of a central pixel of the target image block. Those of the search image blocks detected to be available are estimated using a predetermined estimation manner to determine one of the available search image blocks as a candidate image block. All pixels in the target image block are respectively filled with all pixel values in the candidate image block.