A spectral data processing apparatus includes an analyzer configured to perform principal component analysis of spectral data acquired for each of a plurality of regions of a sample, wherein the analyzer obtains an eigenvector by performing the principal component analysis of first spectral data of a first region out of the plurality of regions, and performs the principal component analysis of second spectral data of a second region different from the first region out of the plurality of regions using the obtained eigenvector.