In a moving body tracking using image data, while the moving body of a target has few outstanding features in appearance and a plurality of images similar to that of the target moving body exist in image frames, the moving body is tracked with high accuracy by evaluating a motion model (for example, a motion of a ball follows the law of motion and the ball is likely located above the table-tennis table) in a given environment (for example, table-tennis) from image data.