A system that generates a 3D environment from data collected by depth sensors (such as LIDAR) and color sensors (such as color video camera data) observing an area or activity, transmits versions of the 3D environment to various devices for display, and enables device users to dynamically alter a viewing angle of the 3D environment. The version of the 3D environment sent to each device may be optimized for the device's resolution and for the bandwidth of the connection to the device. Embodiments may enrich the 3D environment by detecting and tagging objects and their locations in the environment, and by calculating metrics related to motion or actions of these objects. Object tags and metrics may be transmitted to devices and displayed for example as overlays of images rendered from user-selected viewing angles. Embodiments of the system also enable 3D printing of an object as a memento for example.