A method of displaying augmented reality comprises identifying an object as a totem having at least one user input element, capturing at least one image of an interaction of at least one finger of a user of an augmented reality system with the at least one user input element of the totem, detecting at least one characteristic pertaining to the interaction of the finger(s) of the user with the user input element(s) of the totem based on the capture image(s), and determining a user input based at least in part on the at least one determined characteristic.