A conference system and a method of switching a connection terminal in the conference system are provided. The conference system according to one embodiment of the present disclosure includes a web conference server configured to receive a request for switching a connection terminal from a first terminal and acquire identification information of a second terminal included in the request for switching a connection terminal; and an audio conference server configured to process a connection of the second terminal to an audio conference and transmit identification information of the second terminal to the web conference server, wherein the web conference server compares the identification information of the second terminal acquired from the first terminal with the identification information of the second terminal received from the audio conference server and updates participant information of the audio conference, which is mapped with participant information of the web conference.