An augmented reality (AR) application allows for the specification of various lighting conditions, or lighting states, that can be simulated for an augmented reality view of a scene. This can include, for example, specifying a time of day to cause the view to be rendered with a specific amount of sunlight, or specifying a state of various light sources that can impact the illumination of the scene. A light map and lighting state data can be determined for the scene. A change to the lighting state data can result in a filter being applied to the live view of the scene to cause the overall appearance to correspond to the target lighting state. Augmented reality content displayed with respect to the live view can be rendered to have an appearance that corresponds to the altered live view. AR content can also be used to update the appearance of shadows.