An analysis method implemented by a computer includes: generating a refine image by changing an incorrect inference image such that a correct label score of inference is maximized, the incorrect inference image being an input image when an incorrect label is inferred in an image recognition process; and narrowing, based on a score of a label, a predetermined region to specify an image section that causes incorrect inference, the score of the label being inferred by inputting to an inferring process an image obtained by replacing the predetermined region in the incorrect inference image with the refine image.