The methods, systems, techniques, and components described herein allow interactions with virtual objects in a virtual environment, such as a Virtual Reality (VR) environment or Augmented Reality (AR) environment, to be modeled accurately. More particularly, the methods, systems, techniques, and components described herein allow interactive virtual frames to be created for virtual objects in a virtual environment. The virtual frames may be built using line primitives that form frame boundaries based on shape boundaries of virtual objects enclosed by the virtual frame. An area of interactivity defined by the virtual frame may allow users to interact with the virtual object in the virtual environment.