A focus control apparatus includes a signal generator for generating a first signal in accordance with a predetermined frequency component of an image signal obtained by photoelectrically converting an image of a subject formed by an image-taking optical system, a detector for detecting a second signal different from the first signal, and a controller for detecting a movement of the subject based on the second signal and for switching driving of the image-taking optical system based on the detection, wherein the controller controls driving of the image-taking optical system based on the first signal.