An adaptive VR system is provided, which includes a headset and a handle, the headset comprises a headset camera, a control end, and an electromagnetic receiving module, and the control end comprises a control end database and a data selection module; the handle comprises a handle camera and an electromagnetic transmitting module; the headset camera is configured to acquire an external environment image in a headset coordinate system; the handle camera is configured to acquire an external environment image in a handle coordinate system; the control end database is configured to store the external environment image of the handle coordinate system; the data selection module is configured to determine a tracking mode used for tracking the handle, the tracking mode comprising optical tracking; and the electromagnetic receiving module is connected to the data selection module.