An encoder apparatus includes a memory and a processor to receive video data including a plurality of frames that have been captured in multiple imaging directions in a time series; to separate the frames included in the received video data, by the imaging directions; to store, for each of the imaging directions, the separated frames in the memory; to calculate, for each of the imaging directions, based on sequence numbers of the frames stored in the memory before separation, a frame rate of the video data including the frames; and to encode, for each of the imaging directions, the video data that includes the frames stored in the memory at the frame rate calculated with respect to the imaging direction, and to output the encoded video data.