Methods and systems are provided for displaying images onto an arbitrary surface, using a projector, such that the quality of the images is preserved despite surface imperfections or color variations. Methods and systems are also provided for controlling the appearance of a projection surface. Various embodiments use a detailed radiometric model and a calibration method to determine the pixel values required to be projected by a projector in order for a camera to observe a desired image. Other embodiments use a compensation algorithm that uses a feedback approach to provide the desired image compensation. Geometric mapping may be used to establish a correspondence between points in the images to be displayed by the projector and the corresponding points in the images that are captured by the camera.