The present invention makes it possible to include, when encoding processing is applied to three color components using a 4:0:0 format, data for one picture in one access unit and makes it possible to set the same time information or the same set encoding modes among the respective color components. In an image encoding system for applying compression processing to an input image signal including a plurality of color components, encoded data obtained by independently subjecting an input image signal of each of the color components to encoding processing and a parameter indicating which color component the encoded data corresponds to are multiplexed with a bit stream. In an image decoding system for inputting a bit stream in which an image signal including a plurality of color components is compressed to perform decoding processing, decoding processing of the encoded data of each of the color components is performed using a parameter indicating which color component the encoded data corresponds to.