A framework system and method for developing hybrid voice/video QoE predictors, which use both network/codec/client parameters as well as the voice/video reference sample(s). The prediction model/algorithm uses deep packet inspection to produce relevant input and therefore the network's impact on the voice/video QoE can be determined without recording actual media (voice/video) content. Therefore, the QoE predictors are neither solely media based as available perceptual metrics, nor available parametric based. The present hybrid voice/video QoE uses the reference/original media information, unlike prior art hybrid video only QoE which use the recorded media (video only).