A first encoder divides an encoding target image included in a video into a plurality of blocks, and encodes each of the plurality of blocks by performing a prediction coding by use of filtering processing. A second encoder encodes a parameter that represents a direction of a line of pixels in the filtering processing. Here, when an encoding target block that is one of the plurality of blocks has a rectangular shape, the second encoder changes, according to a direction of a long side of the rectangular shape, a process of encoding the parameter.