There is provided an image processing device including a camerawork determination unit configured to determine camerawork at a time of imaging and set a determination start timing of a main subject in image data on the basis of the determination, and a main subject determination unit configured to determine the main subject among subjects contained in the image data from the image data from the determination start timing.