Disclosed is a rendering system that dynamically changes the resolution at which image data in a field-of-view (“FOV”) is rendered based on the proximity or depth of the image data relative to the render position or camera position. The rendering system selects the image data that is within the FOV, and generates a depth map with a set of distance measures for different distances or depths of the image data in the FOV. The rendering system selects a dynamic resolution at which to render the FOV based on the set of distance measures from the depth map, and renders the image data and/or FOV at the dynamic resolution.