There is provided with a signal processing method. A filtering result is generated by performing spatial filtering on multi-dimensional data. Encoding result data is output by encoding the filtering result using a value at a pixel of interest of the filtering result and a value at a reference pixel located at a relative position with respect to the pixel of interest. The relative position of the reference pixel is decided in advance according to a characteristic of a spatial filter used in the spatial filtering step.