A user interface for a communication device allows a user to set up and manage conference communications. The user interface has an active communication area and a held communication area. Communication icons representing communications at the communication device are shown in either the active or held areas of the user interface. By detecting where a user has positioned one or more communication icons within the user interface, the communication device handles the communications to place communications in conference, place communications on hold, swap held and active communications, or disconnect communications.