In general, this disclosure is directed to decoding techniques for interpolating video frames. In particular, this disclosure describes techniques for analyzing block information associated with one or more blocks of pixels and adjusting the block information associated with the block of pixels based on the analysis to reduce artifacts in the interpolated frame. As an example, an interpolation decoder module may analyze and adjust block information associated with one or more blocks of pixels in an interpolated frame. As another example, the interpolation decoder module may adjust block information associated with one or more blocks of pixels in a reference frame that is used for interpolating a skipped video frame. The block information adjustment techniques described in this disclosure may result in a reduction of shaking static background artifacts, blocky artifacts or other types of artifacts in the interpolated frame.