A distance detection device is provided, including a calculating unit that calculates a distance to a detection target using a length of time until floodlighted light is received by a light-receiving unit; a first detecting unit that detects whether detection target changing operation is being performed; a second detecting unit that detects variation in the distance calculated by the calculating unit; a shake correcting optical system that is driven based on a shake detection result and through which the floodlighted light passes; and a control unit that controls driving of the shake correcting optical system using an output from the first detecting unit and an output from the second detecting unit.