A talk deciding system includes a receiving portion which receives far-end side decision information indicating a talking state on a far-end side, an inputting portion which inputs an emitted signal from the far-end side, a speaker which emits the emitted signal being input into the inputting portion, a microphone which picks up a voice on a near-end side and outputs a picked-up signal, and a deciding portion which preliminarily decides a talking state on the near-end side based on the picked-up signal being output from the microphone and the emitted signal being input into the speaker, and generates near-end side decision information indicating a talking state on the near-end side. The deciding portion decides the talking state on the near-end side based on the far-end side decision information being received at the receiving portion and the near-end side decision information.