There is provided a signal processing apparatus including a recognition section configured to recognize at least one of a state of a first user, a state of a second user, and a relationship between the first user and the second user, a signal processing unit configured to perform signal processing on voice information corresponding to voice articulated by the first user, or voice information corresponding to voice that is transmitted from a remote location and articulated by the second user, and a control unit configured to control the signal processing unit to perform signal processing on at least one of the voice information corresponding to the voice articulated by the first user, and the voice information corresponding to the voice that is transmitted from the remote location and articulated by the second user, in accordance with a recognition result of the recognition section.