This is directed to determining the relative position of several devices by capturing representations of the device environments in which a tag is located. The devices can compare the captured representations to determine a perspective of the tag corresponding to each device. In some cases, a device can determine an absolute position relative to a coordinate system integrated in a tag. Using the positioning information, several devices can receive directions to come together at a particular meeting point. In some cases, several devices can operate an application that requires the interaction of several users of the devices (e.g., multi-player games). The application can control the time or manner in which inputs are provided based on the relative positions of the devices. In some cases, the devices can display virtual content that is shared across several devices, where the different devices can each interact with the virtual content.