There is provided a decoding device including a decoding determination unit that determines a procedure of recovering and decoding missing packets in consideration of a packet missing pattern in data including a set of media packets and redundant packets generated by a two-dimensional XOR-based forward error correction FEC encoding method, and a decoding unit that executes the recovery of the missing packets according to the procedure determined by the decoding determination unit.