The disclosed techniques enable systems to provide agenda driven control of user interface environments. A conference system can perform a contextual determination and automatically select and apply a suitable corresponding 2D or 3D user interface construct for the conference participants. The system can also cause client endpoints to switch display between 2D and 3D settings using different user interface constructs. A system can perform contextual determination utilizing a meeting agenda and identify a meeting type based on agenda items such as: a Financial Report, a Brainstorming Session, and a Social Gathering. In response, the system automatically applies proper 2D and 3D constructs with scenes suitable for each agenda item: a conference hall with large presentation screens for the Report, a virtual room with a whiteboard for the Brainstorming Session, and a virtual room with a party theme for the Social Gathering.