An augmented reality system may generate an augmented reality environment by projecting images onto various surfaces within a scene. A projection accessory display device (PADD) provides known characteristics for projection, and may be configured to simplify generation and maintenance of the projected image upon the PADD. The PADD may also provide one or more input devices which accept input from a user within the augmented reality environment. The PADD may comprise non-electronic passive components, electronic active components, or a combination thereof.