A method for automatically determining machine vision tool parameters is presented, including: marking to indicate a desired image result for each image of a plurality of images; selecting a combination of machine vision tool parameters, and running the machine vision tool on the plurality of images using the combination of parameters to provide a computed image result for each image of the plurality of images, each computed image result including a plurality of computed measures; comparing each desired image result with a corresponding computed image result to provide a comparison result vector associated with the combination of machine vision tool parameters, then comparing the comparison result vector associated with the combination of machine vision tool parameters to a previously computed comparison result vector associated with a previous combination of machine vision tool parameters using a result comparison heuristic to determine which combination of machine vision tool parameters is best overall.