A system for managing multiview streaming video data composed of a plurality of frames includes an encoder configured to encode multiple representations of at least one frame of the plurality of frames corresponding to multiple views using different reference frames for each of the multiple representations. The system also includes a controller configured to create a coding tree containing the plurality of frames and the multiple representations. The system further includes a data store configured to store the coding tree, wherein the controller is further configured to identify a storage constraint of the data store and to omit at least one of the multiple representations from the coding tree to cause the plurality of frames stored in the data store to remain within the storage constraint.