A sound recording device includes an input unit, a timing detection unit, a section setting unit that sets a first section including a section in which an operation unit operates in a sound signal, a reference signal determination unit that determines, as a first reference signal, the sound signal corresponding to a second section following the first section, a signal detection unit that detects, as a second reference signal, a sound signal with the highest correlation with the first reference signal, an interpolation signal detection unit that detects, as an interpolation signal, a sound signal that follows the second reference signal detected by the signal detection unit in the sound signal and has the same time length as the first section, a signal replacement unit that replaces the sound signal in the first section with the interpolation signal, and a recording unit that records the sound signal replaced by the signal replacement unit.