A method of changing colors in a video comprises providing a paint map image video comprising multidimensional location information of spatial points of an animated object, providing a rendered replacement image video comprising visual colors, each visual color comprising a transparency and shades of multiple linearly independent colors, identifying a first replacement image location on the animated object in a frame of the replacement image video, the first replacement image location having a first visual color, identifying a first paint map image location corresponding to the first replacement image location in a corresponding frame of the paint map image video, the first paint map image location represented by a first spatial color, creating a color mapping function that maps the first spatial color to a different visual color, and providing an altered rendered replacement image video that has been rendered according to the color mapping function.