A game process is performed by obtaining control data from a game controller. Distance data associated with the distance between the game controller and a predetermined measured reference provided in a real space is calculated by using the control data obtained from the game controller. Then, a predetermined game process is performed on a virtual game world through an operation based on the value of the distance data. Then, the virtual game world after the game process is displayed on a display device.