Systems and methods are disclosed for performing local adaptive weighting upsampling. An image may be converted into a color space representation. The color space representation of the image may then be divided into the individual color spaces. Upsampling may then be performed on the individual color planes. The upsampling may include resizing the color planes by adding pixels to the color planes. Local processing of the different color spaces may be performed to estimate values for the added pixels. Upon generating the estimated values, the estimated values may be refined by determining which known pixel values from the original image have the highest degree of influence on a newly added pixel.