The invention provides a method and a test server for video quality evaluation. According to the method and the test server provided by the invention, a clustering method is used for performing multi-dimensional classified summation for historical sample point data, thus, similarity of grouped data is improved and analysis data volume is simplified. Moreover, according to the method and the test server provided by the invention, a sampling rule is used for performing evaluation for a specified video clip, and sampling efficiency is improved. Moreover, according to the method and the test server provided by the invention, a sampling mode of combination of basic sampling points and a supplementary sampling method based on variance threshold is also used, data points of which variance volatility is greater than the threshold are taken as complement of a data set obtained by the basic sampling points, and accuracy of sampling is improved.