Devices, systems and methods for encoding and decoding digital video using historical information containing coding candidates are described. In a representative aspect, a method for video processing includes maintaining one or more tables of motion candidates during a conversion between a current video block and a bitstream representation of a video, comparing a motion candidate associated with the current video block with a number of entries in the one or more tables, and updating the one or more tables based on the comparing.