A video encoder includes: a motion compensation picture signal generator to generate a plurality of motion compensation picture signals in accordance with an encoding target signal and a plurality of reference pictures; a prediction signal generator to generate a prediction signal of the encoding target signal by utilizing the plurality of motion compensation picture signals; a prediction error signal generator to generate a prediction error signal; a selector to select, from among a plurality of scan patterns prepared for generating encoded information from the prediction error signal, a scan pattern that is expected to minimize an information amount of an encoded state of the prediction error signal, in accordance with the plurality of motion compensation picture signals; and a zigzag scanner to generate encoded information from the prediction error signal by using the scan pattern selected by the selector.