An image processing apparatus includes a display for displaying an image layouted in accordance with arrangement information, an editing unit for editing the displayed image, a storage unit for storing a plurality of pieces of arrangement information, an arrangement information selecting unit for selecting the arrangement information used for layouting the image after editing in accordance with the arrangement information of the displayed image and editing information, and an image layouting unit for layouting the image in accordance with the selected arrangement information. With such a configuration, an image having no sense of discomfort after editing can be displayed upon editing such as adding or deleting of an image on a page or double pages displayed in a photo book or the like.