Disclosed is a virtual extreme golf system including a sensor that generates step information by measuring a user's step and generates swing information by measuring angular velocity and acceleration of a stick, a controller that includes a DB unit in which course information is stored, a position change unit changing a position of a ball on a course through the swing information and generating position information of the ball, and a time calculation unit that generates time information by calculating a movement time of the user to a position of the ball before the swing and a position of the ball after the swing on the course by using the step information, and an output device that receives and outputs at least one of the course information, the position information, and the time information.