A method for streaming scene-based media assets during a media streaming session performed by a computing device is provided. The method includes providing a bi-directional interface for communicating information about scene-based media assets between a network server and the computing device acting as a client device; and providing, to the network server via the interface, client device attributes and corresponding information related to availability of client device resources when requested, wherein the client device attributes and the information are used by the computing device for rendering the scene-based media assets. For example, the computing device receives a request from the network server and then determines whether the requested scene-based media assets is to be streamed from the network server or not by accessing a list of locally stored, previously streamed scene-based media assets. The network server then generates the scene-based media assets or their proxies and inserts them into the media streaming session to be streamed to the computing device for rendering the scene-based media assets.