A control apparatus includes a first focus detection unit that performs focus detection by a phase difference method based on an image signal obtained from an image pickup element, a second focus detection unit that performs focus detection by a contrast method, and a control unit that performs focusing, the control unit performs the focusing, in a first mode, by using a detection result of the first focus detection unit, and performs the focusing, in a second mode, by selectively using one of the detection result of the first focus detection unit and a detection result of the second focus detection unit according to lens information, and the first mode is a mode in which the focusing is repeated, and the second mode is a mode in which a lens is stopped after the focusing.