The invention relates to an aerial photographed video target tracking method based on related filtering and significance testing. Through the tracking method based on related filtering and significance testing, a direction gradient histogram characteristic and a gray-scale characteristic are utilized for realizing high robustness of a tracking result to factors such as illumination change, noise and shield. Particularly when a target is severely shielded and tracking failure occurs, the aerial photographed video target tracking method realizes target detection through a redetection mechanism, so that long-time continuous tracking of the target can be realized. Furthermore, a significance detecting method based on a residual spectrum theory realizes simple and quick calculation. Redetection to the target can be realized through a relatively low calculation cost. A requirement for real-time performance of an algorithm in aerial photographing video tracking can be effectively satisfied.