The communication support device includes: a storing unit configured to store an utterance of a first speaker transmitted from a first terminal as utterance information; an analyzing unit configured to obtain a holding notice which sets communications with the first terminal to a holding state, the communications being transmitted from a second terminal used by a second speaker who communicates with the first speaker, and to analyze features of utterance information which correspond to a time of a holding state; and an instructing unit configured to output to the second terminal determination information on the first speaker based on the features of the utterance information of the first speaker.