A high-resolution remote sensing image is processed through a true ortho-rectification. A totally new idea of H-buffer is provided to store heights of objects on the ground. The ortho-rectification includes a hidden analysis, a hidden detection and a hidden compensation. The process uses polygon patch of a building or a roadway as process unit. In the end, seam lines after hidden compensation are smoothed. The whole process time is reduced in calculations, assures quality of the orthoimage, and meets a requirement of a high-accuracy and high-resolution digital mapping.