Variable image data reduction is applied to at least a subset of each frame of a video file. The variable image data reduction includes reducing data by one or more techniques, such as compression, decimation, distortion, and so forth, across the frame by a different degree or amount based on a viewing location of the user. Thus, the amount of data sent to an encoder for delivery to a client device (e.g., head mounted display (HMD) or other computing device) is lowered by prioritizing image quality for the viewing location of the user while one or more data reducing techniques are applied to the remainder of the frame.