An improved augmented reality object handling system, including: a display device; a camera functionally coupled to the display such that visual data from the camera is displayed on the display; an augmented reality object, including rendering data configured to provide instructions for displaying the AR object on the display; behavior instructions, the behavior instructions including interaction instructions for how the AR object interacts with visual data from the camera and/or other AR objects; and a characteristic interaction broker in communication with the AR object, wherein the interaction broker loads into memory interaction instructions from associated AR objects, tracks positions of associated AR objects, and triggers interactions based on loaded interaction instructions, characteristics, and tracked positions.