A virtual image generation apparatus includes an image recording unit configured to record a plurality of images, each containing photography position data. An image selection unit selects, from the images recorded, an image from which to generate a virtual image. A map-image acquiring unit acquires an image corresponding to a map image containing the photography position data contained in the image selected A virtual scene image generation unit generates, from the image corresponding to the map image, a virtual image showing the image selected or showing a scene related to the photography position data contained in the image selected. An output unit outputs the virtual image data, thereby to display the scene represented by the virtual image generated.