Upon playback of stream data which is recorded while being appended with time stamp information in units of packets, time management is made using the time stamp information. A video playback time viewed from the user, which may be indicated by I-, B-, and P-picture display times, is different from the time of the time stamp information. For this reason, when time management for the stream data recorded on an information storage medium is made using only the time stamp information, display time control (video playback time control) for the user cannot be accurately done. In this invention, a time relationship table indicating the relationship between the time stamp information recorded in stream data at each I-picture start time position and display time information (PTS or field information) for the user is provided to a portion of management information.