The present invention provides a moving image analyzing apparatus, method and system. The moving image analyzing apparatus comprises a moving image reading means for reading a moving image, a region-of-interest extracting means for extracting a region-of-interest from each frame in the moving image, an object feature extracting means for extracting an object feature in the region-of-interest or a region adjacent to the region-of-interest, and a shot change detecting means for detecting a shot change on the basis of the color feature of image, the object feature of the region-of-interest, and the differences of the motion information among the images of each frame. By estimating the reliability of the motion information within an image, the present invention can eliminate the shot change which is incorrectly detected according to the color distribution feature and the dimensional feature of the region-of-interest, thereby improving the detection accuracy of shot change.