A technique for encoding a video signal includes generating a representative value for each block of one or more video frames by applying a predetermined function to the pixels of the respective block. To perform a block matching operation for a current block, the technique applies the predetermined function to the current block and interrogates representative values of blocks at specified locations in a spatial and/or temporal vicinity of the current block to find a matching block whose representative value matches the one generated for the current block.