A method and system for enhancing image resolution using optical image translation, including: receiving multiple dissimilar low-resolution images generated by a time varying linear phase mask (LPM); receiving a direction vector for each of the multiple dissimilar low-resolution images; interleaving the received multiple dissimilar low-resolution images using the received direction vectors to form an intermediate high-resolution image; computing a likelihood of pixel motion in the intermediate high-resolution image; compensating for pixel motion in the intermediate high-resolution image; and generating a final high-resolution image.