A method of performing adaptive temporal prediction includes receiving a target image, wherein a position of an object in the target image is different from a position of the object in a reference image, using a boundary of the object to generate an irregular pattern of target image motion vectors, using the target image motion vectors to partition the target image into area of influence cells, wherein each area of influence cell contains a unique one of the target image motion vectors, and generating a prediction of the target image by applying an adaptive area of influence filter to the area of influence cells.