An optical device that is capable of reducing eccentric aberration while reducing image blur. A first shake correction unit corrects image blur optically based on a shake amount that is detected by a shake detection unit. A second shake correction unit corrects image blur optically based on a shake amount that is detected by the shake detection unit. The second shake correction unit has a different image blur correction effect from the first shake correction unit. The optical device has a mode in which shake correction is performed using the first shake correction unit without using the second shake correction unit.