A network system, such as a transport management system, generates a mutual augmented reality (AR) experience for a user and a provider associated with a service. Responsive to receiving a service request, a service management module matches the user with an available provider and monitors the location of the user and provider client devices as the user and provider travel to the pickup location. When the devices are within a threshold distance of each other, an image recognition module monitors live video streams on the devices for the vehicle and the user. Responsive to the vehicle and user entering the field of view of the devices, an AR control module selects computer-generated AR elements and instructs the devices to visually augment the video streams to identify the user and provider to each other and to allow the user and provider to communicate and share data with each other.