Certain aspects of a method and system for adaptive temporal interpolation filtering for motion compensation may include computing a plurality of weights for adaptively adjusting one or more parameters of a plurality of linear filters utilized for motion compensation. One or more motion compensated output pictures may be generated based on vector median filtering a plurality of linear filtered output pictures generated by the plurality of linear filters. In instances where two frames are utilized for motion estimation of a video sequence, a motion compensated picture of a previous frame and a motion compensated picture of a current frame may be combined to adaptively compute the subsequent weights. In instances where three or more frames are utilized for motion estimation of a video sequence, the generated one or more motion compensated output pictures may be combined with an extracted desired picture from the video sequence to adaptively compute the subsequent weights.