There is provided an image processing apparatus and method that can curb deterioration in coding efficiency. An inverse orthogonal transform of chrominance is performed using information regarding the inverse orthogonal transform of chrominance derived on the basis of information regarding an inverse orthogonal transform of luminance. For example, information regarding the orthogonal transform includes an adaptive primary transform flag indicating whether an adaptive primary transform of adaptively selecting one from a plurality of different orthogonal transforms and using the selected transform as a primary transform is to be applied to a transform block to be processed. The present disclosure can be applied to, for example, an image processing apparatus, an image encoding apparatus, an image decoding apparatus, or the like.