A method of encoding video is provides encoding of panic scenes efficiently. The method includes receiving an input video at an encoder, reviewing lookahead information from a second encoder that processed the input video ahead of the encoder that indicates positions of panic scenes within the input video that caused the second encoder to enter a panic encoding mode during which it skipped the encoding of frames, entering a pre-panic stage with the encoder ahead of said panic scenes, entering a semi-panic stage with the encoder during the panic scenes when it produces a bitstream having a number of bits exceeding a predetermined data size within an encoder buffer, and entering a full panic stage when the semi-panic stage does not bring the number of bits in the bitstream below the predetermined data size.