A multi-dimensional data enhancement system uses large kernel filtering, decimation, and interpolation, in multi-dimensions to enhance the multi-dimensional data in real-time. The multi-dimensional data enhancement system is capable of performing large kernel processing in real-time because the required processing overhead is significantly reduced. The reduction in processing overhead is achieved through the use of low pass filtering and decimation that reduces the amount of data that needs to be processed in order to generate an unsharp mask comprising low spatial frequencies that can be used to process the data in a more natural way.