This document describes techniques and apparatuses for implementing multi-spectral compression. These techniques enable a computing device to capture a set of images at different spectral sensitivities using a multi-spectral array imager. Once the set of images are captured by the multi-spectral array imager, the set may be encoded using encoding techniques that involve spectral prediction in addition to spatial and temporal prediction.