Systems and methods are provided for focus recovery of multi-channel images. Control circuitry of an imaging system can restore an image by removing image blurring introduced by the lens, sensor noise introduced by the sensor, and a signal offset between multiple channels of the image. In some embodiments, the control circuitry can calculate one or more estimates of a signal offset of multiple observed signals. Using statistics generated from offset-removed signals, the control circuitry can generate one or more recovery kernels which can be applied to offset-removed signals to generate recovered signals. In other embodiments, instead of explicitly removing a signal offset from each observed signal, the control circuitry can implicitly remove the signal offset when calculating the first and second order statistics of one or more observed signals.