One or more users wear respective wireless headsets or visors that allow the users to see a 3D rendered virtual reality environment emulating the physical space in which the user(s) are located and move. A user is allowed to move freely throughout the physical space while playing. The virtual reality environment that is rendered for a user is based on the user's physical movements. The virtual reality environment rendered for a user shows virtual objects where the corresponding physical objects are located so that as the user moves around the objects in the virtual environment the user also moves around the physical objects in the physical space. The floor of the physical space may be made of movable segments that move according to game play instructions.