A prosody identifying apparatus for identifying input speech on the basis of prosodic features of the input speech is provided. The prosody identifying apparatus includes a sound analyzing section for acquiring an amount of change in movement of a feature distribution obtained from an autocorrelation matrix of the frequency characteristic of the input speech and an identifying section for recognizing the input speech on the basis of an output of the sound analyzing section.