A multi-modal imaging device can include a sensor array, a metamaterial filter, and a memory unit. The sensor array can be any suitable sensor which detects incoming light and is capable of recording a received image. The metamaterial filter can be oriented adjacent the sensor array and can be patterned with pixels having varied physical heights designed to diffract an incoming image to produce an engineered response which is sensitive to 2D spatial coordinates (x, y), time (t), and at least one of depth spatial coordinate (z), spectrum (λ), and degree of polarization ({right arrow over (S)}). The memory unit can include instructions that, when executed by a processor, reconstruct the engineered response to produce a reconstructed image which includes the 2D spatial coordinates and at least one of z, λ, and {right arrow over (S)}.