The luminance information of an image captured by a multi-lens camera system can be improved by selecting a luminance information source for each portion of the captured image. Each lens of the camera system can capture an initial image. For each portion of a final image, a corresponding initial image portion can be selected as the luminance information source. The portions of the final image and initial images can be pixels, groups of pixels, or other image portions. The luminance information from the selected initial image portions is combined to form final image luminance information. Chrominance information can also be selected from the initial images to form final image chrominance information, and the final image chrominance information and the final image luminance information can be combined to form a final image.