A system and method for extending bounds of straightened and enlarged images is described. A user interface of an image editing application exposes an image to a user for editing. The user positions the image in the user interface and the image editing application generates a frame in the user interface to identify boundaries of a final image in the user interface. The image editing application then automatically determines an empty area within the frame, applies a fill operation to the empty area within the frame, and updates the image in the user interface to reflect results of the fill operation.