A breast image analysis method, breast image analysis system and non-transitory computer-readable medium are provided in this disclosure. The breast image analysis method includes the following operations: inputting a first breast image and a second breast image; extracting a plurality of first feature points of the first breast image and a plurality of second feature points of the second breast image; calibrating the first breast image and the second breast image according to the first feature points and the second feature points to generate a first calibration image and a second calibration image; calculating a first difference image and calculating a second difference image; utilizing an image analysis model to respectively determine whether the first difference image and the second difference image are symmetric; and generating an analysis report representing a symmetry result or an asymmetry result.