A hand-held game apparatus and a game program are provided which allow a user to play a game while going back and forth between two kinds of maps, namely, a narrow-range map and a broad-range map game, and arbitrarily change the displayed state of at least one of the broad-range map and the narrow-range map by manipulating a touch panel which is mounted on a liquid crystal display section for displaying the broad-range map. If the player manipulates the touch panel to point to a coordinate position on the broad-range map, thus designating coordinates for a narrow-range map to display, an image of the narrow-range map, which is changed as desired, is displayed. If the player indicates a moving direction on the broad-range map, thus designating a scroll direction, the broad-range map is moved (scrolled).