A video quality objective assessment device includes a temporal/spatial feature amount derivation unit (12) which derives a temporal/spatial feature amount (PC) which is the feature amount of deterioration which has occurred in a deteriorated video signal (PI), from the deteriorated video signal (PI) to be assessed and a reference video signal (RI) which is a signal before deterioration of the deteriorated video signal, and a subjective quality estimation unit (14) which weights the temporal/spatial feature amount (PC) according to the relationship between the deteriorated video obtained in advance and the user subjective assessment value, thereby estimating the subjective quality (Y) of the deteriorated video signal (PI). Thus, it is possible to estimate a video subjective quality even when deterioration occurs locally in the video in the temporal/spatial direction.