A projection system that prevents projection light on a presenter and provides a gesture based interface for visual enhancements is disclosed. The system may include a projector camera system comprising a computer communicating an image to a projector, the projector projecting the image on a screen, a stereo camera unit mounted approximately in the plane of the screen or at the projector and directed toward the presenter and communicating with the computer, and software that interprets the stereo camera data to distinguish and manipulate foreground and background features. The foreground feature may be the presenter relative to the screen or to the audience and room, or the presenter's hand relative to the presenter. The invention employs imaging stereo camera algorithms and techniques developed for foreground/background segmentation, image manipulation, and gesture recognition.