A temporal domain rate distortion optimization considering a coding-mode adaptive distortion propagation is provided. A problem of dependency rate distortion optimization based on a temporal domain distortion propagation is induced again according to a temporal domain dependency relationship under an LD structure and a distortion propagation analysis under a skip mode and an inter mode; and an aggregation distortion of a current coding unit and an affected future coding unit are estimated and a propagation factor of a coding unit in a temporal domain distortion propagation model is calculated by constructing a time propagation chain, wherein a Lagrange multiplier is adjusted through an accurate propagation factor to realize a temporal domain dependency rate distortion optimization, and an I frame is subjected to a secondary coding technology to realize the temporal domain dependency rate distortion optimization of the I frame.