An image processing apparatus comprises an image obtaining unit that obtains image data based on image capturing by a plurality of image capture apparatuses configured to capture images in an imaging area from different positions, and a panoramic image generation unit that generates, based on the image data obtained by the image obtaining unit, a panoramic image including images in directions within a predetermined range based on a specific position in the imaging area, the panoramic image having an enlargement rate of an image in a specific direction included in the predetermined range which is larger than the enlargement rates of images in other directions.