A system and method for performing a facial image restoration is described. The system includes an active appearance model component for fitting an active appearance model to a facial image found in each of a plurality of video frames, a registration component for registering each pixel of each facial image with comparable pixels of each of the other facial images, and a restoration component for producing a restored facial image from the facial images. The method includes fitting an active appearance model to a facial image found in each of a plurality of video frames, registering each pixel of each said facial image with comparable pixels of each of the other facial images, and producing a restored facial image from the facial images.