A handwritten word is transcribed into a list of possibly correct transcriptions of the handwritten word. The list contains a number of text words, and this list is compared with previously stored set of lists of text words. Based on a metric, one or more nearest neighbor lists are selected from the set. A decision is made, according to a number of combination rules, as to which text word in the nearest neighbor lists or the recently transcribed list is the best transcription of the handwritten word. This best transcription is selected as the appropriate text word transcription of the handwritten word. The selected word is compared to a true transcription of the selected word Machine learning techniques are used when the selected and true transcriptions differ. The machine learning techniques create or update rules that are used to determine which text word of the nearest neighbor lists or the recently transcribed list is the correct transcription of the handwritten word.