A method for obtaining trajectory of an object using multi-path tracking mode is provided. The method includes marking a portion of the object in a frame of a video, obtaining consecutive frames in the video, and tracking the marked portion of the object in consecutive frames by estimating sum of absolute difference. The method further includes comparing the sum of absolute difference to a sum of absolute difference threshold, switching between the multi-path tracking mode and single path tracking mode based on the comparison of the sum of absolute difference to the sum of absolute difference threshold, and obtaining trajectory of the marked portion by combining the single path tracking mode and multi-path tracking mode.