The present application is applicable to the technical field of image processing, and provides a target object tracking method and an apparatus, and a terminal device. The target object tracking method includes: obtaining an image sequence including a target object, wherein the image sequence includes a plurality of image; analyzing the plurality of image, and determining a motion vector and a motion vector residual of the target object in a current image; and inputting the motion vector, the motion vector residual, and a known target region of the target object in a previous image into a first target detection network, and determining a predicted target region of the target object in the current image. The present application can reduce the calculation amount and thus improve the operation speed of target object tracking.