An image processing apparatus and method is provided to generate a moving picture with a high resolution, a high frame rate and a high SNR by eliminating a decrease in SNR even if the intensity of incoming light has been halved by a half mirror. The apparatus generates a multi-color moving picture based on first and second moving pictures, which respectively have first and second frame rates (where the second rate is higher than the first rate) and are comprised of pictures representing a first color component and pictures representing a second color component different from the first color component. The resolution of the second moving picture is equal to or lower than that of the first moving picture. The apparatus includes: a first image synthesizing section, which generates, based on the data of the first and second moving pictures, a synthetic picture by modifying some of the pictures that form the first moving picture and which outputs a synthesized moving picture corresponding to the first moving picture at a higher frame rate than the first frame rate by using the first moving picture and the synthetic picture; and a second image synthesizing section, which receives and synthesizes together the synthesized moving picture and the second moving picture, thereby generating a multi-color moving picture including the first and second color components.