An acceleration-deceleration determination device includes: a DFT analysis unit which calculate, from an engine sound, a frequency signal at a predetermined frequency for each of predetermined time periods; and an acceleration-deceleration determination unit which determines whether the number of engine revolutions is increasing or decreasing, by determining whether a phase of the frequency signal is increasing at an accelerating rate over time or decreasing at an accelerating rate over time.