A focusing control device includes: a sensor that has a pair of a first signal detection unit that receives one of a pair of beams passed through different parts disposed in one direction in a pupil region of an imaging optical system including a focus lens and detects a signal depending on an intensity of received light and a second signal detection unit that receives other of the pair of beams and detects a signal depending on an intensity of received light, in which a plurality of the pairs that are arranged in the one direction form a pair line and a plurality of the pair lines are arranged in a direction orthogonal to the one direction; an addition correlation operation unit as defined herein; a non-addition correlation operation unit as defined herein; a selection unit as defined herein; and a lens driving section as defined herein.