An autofocus apparatus includes a control unit configured to set an offset amount based on information relating to a shape of a first high-frequency component of an image signal obtained by photoelectrically converting an object image formed by an image pickup optical system that includes a focus lens while driving the focus lens, and to move the focus lens to a position that shifts from a first position of the focus position by a sum of the offset amount and a predetermined amount that is determined by characteristic information of the image pickup optical system.