A video multiplexing apparatus includes: a control unit which determines first decode/display time information and second decode/display time information for each picture in video data and for each encoding unit of first media data; a video packet generating unit which appends the first and second decode/display time information for the picture to encoded data of the video data; and a media packet generating unit which appends the first and second decode/display time information for the encoding unit to encoded data of the first media data. The first decode/display time information is used when the decoding unit of the video data is a picture, and the second decode/display time information is used when the decoding unit is a sub-picture. The picture display time based on the second decode/display time information is earlier than the picture display time based on the first decode/display time information.