Communication from inadmissible communication parties and communication accesses are excluded from an unspecified number of communication parties and communication accesses. A communication management system is provided with a communication device for communicating with communication parties connected through a communication network, a communication control device for controlling the communication, a communication history information memory device for storing communication history information indicative of communication history of the communication device, and a communication admissible party selecting device for selecting communication admissible parties who are admitted to communication with the communication device in accordance with the communication history information, wherein the communication control device has a communication admission control function to carry out admission control of communication from the selected communication parties.