The invention discloses a panoramic imaging method based on a camera array and mainly aims to solve the problems that in the prior art, a splicing scene is small, and a "ghost shadow" exists. According to the scheme, (1) array cameras are used to acquire multiple images, two images are read, SIFT features of the two images are extracted respectively, feature matching search is performed, matching points of the two images are obtained and screened, an optimal transformation matrix is calculated, the images are transformed according to the optimal transformation matrix, and an improved optimal stitching line algorithm and a weighted average fusion algorithm are adopted to perform fusion splicing on the images; and (2) the step (1) is repeated till splicing of the upper image and the lower image is completed, the splicing image is used as a to-be-spliced image, splicing is continued after the to-be-spliced image is rotated counterclockwise by 90 degrees, and the result is rotated clockwise by 90 degrees to obtain a final splicing panoramic image. Through the method, the "ghost shadow" phenomenon is remarkably eliminated, and the obtained panoramic image is large in view field, high in resolution, more approximate to a real panorama and capable of being used for splicing of larger scene images in the horizontal direction and the vertical direction.