A method of operating a semiconductor device includes receiving a video stream including a plurality of frames encoded in a hierarchical manner. Each frame is classified as one of a plurality of layers, and the plurality of layers includes a first layer and a second layer. The method further includes decoding the frames classified as the first layer in a chronological order, storing the decoded frames classified as the first layer in a decoded picture buffer (DPB), decoding a latest one of the frames classified as the second layer, storing the decoded latest one of the frames classified as the second layer in the DPB, reading the DPB to display the latest one of the frames classified as the second layer, and decoding and displaying the frames classified as the second layer other than the latest one of the frames classified as the second layer in a reverse chronological order.