A focusing control device includes: an evaluation value calculation unit that causes an imaging element which images a subject through a focus lens to image the subject for each of positions of the focus lens while moving the focus lens movable in an optical axis direction, and calculates evaluation values for determining a focusing position of the focus lens based on signals acquired by performing any filtering process selected among a plurality of filtering processes in which passbands are different on captured image signals acquired through the imaging; a focusing position determination unit as defined herein; and a focusing control unit that performs focusing control to move the focus lens to the focusing position, and the focusing position determination unit increases number of the selected evaluation values as a lower frequency limit of the passband becomes lower, as the filtering process selected by the evaluation value calculation unit.