Embodiments of a system that includes one or more integrated circuits are described. During operation, the system receives a sequence of video images, and calculates brightness metrics associated with the video images in the sequence of video images. Then, the system determines an intensity setting of a light source, which illuminates a display that is configured to display the sequence of video images, and scales brightness values of a given video image in the sequence of video images based on a given brightness metric associated with the given video image. Next, the system changes the intensity setting and scaling the brightness values when there is a discontinuity in the brightness metrics between two adjacent video images in the sequence of video images.