A framework for interactive VR content items provides for user interaction via placement of interaction points within VR content items that would otherwise be passively viewed by users on HMD devices. The interaction points are defined by positional metadata that contains information regarding when and where the interaction points should be displayed during the interactive VR content play. The interaction points are also defined by action metadata that determines one or more actions to be executed when the user selects the interactions points. Selection of the interaction points via one or more of a user gesture and a voice input is also enabled by the framework.