The present invention relates to a video processing device for processing data corresponding to a sequence of pictures according to a predictive block-based encoding technique. Said device comprises a processing unit (20) including a reconstruction circuit (16) for reconstructing pictures from decoded data and an external memory (1) for storing reference pictures delivered by the reconstruction circuit. The processing unit further comprises a memory controller (11) for controlling data exchange between the processing unit and the external memory, a cache memory (17) for temporarily storing data corresponding to a prediction area, said data being read out from the external memory via the memory controller, and a motion compensation circuit (14) for delivering motion compensated data to the reconstruction circuit on the basis of the prediction area read out from the cache memory.