A video quality measurement (VQM) system for a video stream includes a neural network VQM module having a constructed architecture to calculate a video quality metric based on a hybrid of image metric and packet metric of the video stream. An image metric measuring module receives the video stream and calculates the image metric of the video stream. A packet metric measuring module obtains information about packet-level characteristics of the video stream to calculate the packet metric. The image metric and the packet metric are inputted to the neural network VQM module to calculate the video quality metric. The VQM system further includes a VQM test-bed that determines and validates the architecture of the neural network VQM module. Furthermore, a video quality measurement (VQM) method based on a hybrid of image metric and packet metric is also described.