A moving image compression device has an obtaining unit, an image conversion unit, and a compression processing unit. The obtaining unit obtains a RAW moving image having plural frames associated in an order of imaging, the frames having pixels of three different color components which are disposed periodically according to a color array with two rows and two columns. The image conversion unit separates, in a target frame, a first pixel group corresponding to a first color component of odd rows and a second pixel group corresponding to the first color component of even rows, and alternately arrays, in a time base direction, a first image including the first pixel group and a second image including the second pixel group. The compression processing unit performs inter-frame prediction coding compression on the first image and the second image.