An image processing apparatus and method for detecting and tracking multiple moving objects in successive frames includes circuitry configured to detect a plurality of moving regions within a plurality of frames based on an optical flow map of a plurality of pixels within the plurality of moving regions. A plurality of merged objects are identified from the detected plurality of moving regions. A plurality of split objects are identified from the detected plurality of moving regions and the identified plurality of merged objects. A location of each of the detected plurality of moving regions, the identified plurality of merged objects and the identified plurality of split objects is predicted and tracked within the captured plurality of frames.