A field monitoring system using a mobile terminal includes at least one mobile terminal which transmits situation information including video information, audio information and location information and receives three-dimensional (3D) image information corresponding to the situation information, and a control server which receives the situation information from the mobile terminal, generates 3D image information about a current location of the mobile terminal by matching the location information of the situation information with pre-stored map information or architectural drawing information, and transmits the 3D image information to the mobile terminal. The video and audio information is generated by capturing video and sound of a field, and the location information is generated by integrating signals sensed by an accelerometer and a gyroscope sensor with a Global Positioning System (GPS) signal including latitude, longitude and time.