A method of decoding videos comprises the steps of performing, in respect of a decoding objective area of decoding objective frame, a motion search by using images of plural frames finished with decoding and deciding, on the basis of the result of the motion search, whether an image of the decoding objective area is to be generated through an interpolation process or a decoded image is to be generated through motion compensation using data included in an encoding stream.