A method includes receiving first data from a game engine, the first data associated with a virtual interaction between a virtual hand and a virtual object in a virtual world, determining if the virtual object is interactable based on the first data, determining if the virtual hand is touching the virtual object in the virtual world based on the first data, and when it is determined that the virtual object is interactable and the virtual hand is touching the virtual object, outputting second data describing a relationship between the virtual hand and the virtual object based on the first data.