Embodiments are directed to managing display hardware for visualizing data a network computer. A modeling engine may provide a data model includes a plurality of data objects and a display model that includes a plurality of display objects that may be based on the plurality of data objects. Action objects may be associated with display objects in the display model. A display engine may display the display model on a hardware display based on context information that includes performance characteristics of the hardware display. In response to a trigger events, action objects may be displayed on the hardware display based on the context information. In response to detecting input signals associated with the action objects the display model may be modified based on the action objects. The modified display model may be displayed on the hardware display based on the context information.