According to one embodiments a video signal control apparatus includes an average luminance detector and a display luminance controller. The average luminance detector detects the average luminance of a video signal with respect to each frame. The display luminance controller controls the display luminance of a first frame using the average luminance of a second frame prior to the first frame. When luminance change from the average luminance of the first frame to that of the second frame exceeds a predetermined threshold, the display luminance controller replaces the average luminance of the second frame with that of the first frame to control the display luminance of the first frame based on the average luminance of the first frame.