A focus detection device includes: a plurality of micro-lenses at which light fluxes through an image forming optical system enter, disposed in a two-dimensional array pattern; a plurality of light receiving elements disposed in correspondence to each of the plurality of micro-lenses; a focus detection unit that executes a detection of a defocus quantity of the image forming optical system by detecting, based upon outputs from the plurality of light receiving elements, a phase difference of a plurality of light fluxes through different areas of the image forming optical system; and a recognition unit that recognizes, based upon the outputs from the plurality of light receiving elements, characteristics of a subject image formed onto the plurality of light receiving elements via the plurality of micro-lenses, wherein: the focus detection unit detects the defocus quantity through a method optimal for the characteristics of the subject image recognized by the recognition unit.