A method for scaling an image includes providing a set of filters based upon a low-resolution data set and a high-resolution data set suitable for up-scaling a low resolution image to a high resolution image. The filters are collectively representative of at least a portion of an image space and a substantial number of the filters are representative of a different at least one selected from a volume and a shape within the image space. A low-resolution image is received and generates a corresponding high-resolution image based up the filters.