A system and method for modifying media stream based on a channel limitation are disclosed. In one embodiment, the system includes a channel analyzer, a modality of interest (MOI) identification module and an inter-modality resolution modification module. The channel analyzer determines a channel limitation. The MOI identification module receives a plurality of media streams and identifies at least one MOI. The inter-modality resolution modification module modifies a resolution of at least one of the media streams based on the channel limitation and content of the media streams. In another embodiment, the system includes a region of interest identification (ROI) module and an intra-modality resolution modification module instead of, or in addition to, the MOI identification module and inter-modality resolution modification module. The ROI identification module receives a media stream and identifies at least one ROI within the media stream.