A sky filter method for panoramic images and a portable terminal is provided. The method comprises: obtaining several panoramic images containing sky regions as a data set, and marking a sky region and a ground region of each panoramic image to obtain a marked mask image and a panoramic template image of sky; extracting features of the sky region and the ground region of each panoramic image, and marking a positive sample and a negative sample; inputting the positive sample and the negative sample to SVM for training to obtain a model; extracting the features of the panoramic images, and inputting same to the model to obtain an initial mask image; removing a misclassified pixel and a misclassified region in the initial mask image to obtain an accurate mask image; and fuse the panoramic template image of sky and a test panoramic image to achieve a sky filter effect.