A face detection apparatus detecting a face from an image which is captured by an imaging unit and includes the face, includes: a position detection unit that detects a position of a face part of the face from the image; an initial state determination unit that determines a model initial state on the basis of the position of the face part; and a model fitting unit that generates a model of the face on the basis of the image by using the model initial state.