A video signal processing apparatus includes: a gain inverse correction means for giving an inverse correction gain resulting in an inverse correction characteristic to a gain to a video signal subjected to automatic gain control and outputting the video signal; a texture component removing means for removing a texture component from the video signal output from the gain inverse correction means; a gain inverse-inverse correction means for giving an inverse-inverse correction gain to the video signal output from the texture component removing means; a texture component extracting means for extracting a texture component signal, utilizing the video signal output by the gain inverse correction means and the video signal output by the texture component removing means; and a signal synthesizing means for synthesizing a structure component signal based on the video signal output by the gain inverse-inverse correction means and the texture component signal to output a video signal.