A system and method particularly useful in handling the video of a “large” conference is disclosed. The system and method initially defines certain conferees as panel members, which can provide input video signals to the multipoint control unit and can receive output video signals or a composite layout for the conference from the multipoint control unit. The system and method also initially defines audience members, which only passively receive the output video signals or layout from the multipoint control unit and do not have their video signals incorporated into the layout of the videoconference. In one aspect, an audience terminal can request to participate in the conference. By making an appropriate request, the audience terminal can, if system resources are adequate, participate fully as a panel member and may supply video signals to the conference for at least some portion of time. Alternatively, the audience member can supply information other than video signals to the conference, such as voting data or other data allowing the audience member to participate in the conference as more than a merely passive viewing participant.