An image blur correction device includes a motion detection unit and detects a motion of panning, tilting, and camera shake. A motion determination unit determines a motion of an imaging apparatus based on an output of the motion detection unit. A high-pass filter (HPF) removes a low-frequency component from the output of the motion detection unit and a low-pass filter (LPF) removes a high-frequency component from an output of the HPF. A swing-back time period detection unit detects a period of time during which swing-back occurs based on the output of the LPF and the output of the motion determination unit. A gain control unit controls a gain to be multiplied by the output of the LPF based on the output of the detection unit and the output of the motion determination unit. A subtraction processing unit subtracts an output of the gain control unit from the output of the HPF.