A three-dimensional image processing method and a three-dimensional image processing circuit using the above method are provided. The method is configured for processing N source images, and N is a natural number and is larger than or equal to two. Each of the source images corresponds to a visual angle, and each of the source images comprises image data with three primary colors. The image data of each of the source images are arranged in an array according to a predetermined color sequence. In the method, six parameters are provided firstly, wherein each of the six parameters is configured for defining a basic data-arrangement variation. Then, the image data with three primary colors of the N source image are obtained according to the six parameters, so as to form a three-dimensional image.