A disparity estimation method of stereoscopic image is provided. A matching cost computation is executed for a first image and a second image, and one extreme value is selected from cost values corresponding to estimating disparities for each pixel to obtain a matching point corresponding to each pixel. And a matching disparity corresponding to each matching point is adjusted based on edge detection according to a scan order.