A method for scoring and controlling the quality of dynamic food products transitioning in the processing steps is performed using image analysis. An image of a plurality of moving food products on a conveyor system is captured by on-line vision equipment and image analysis is performed on the image via an algorithm that determines the percentage of pixels having varying intensities of colors and applies predetermined preferences to predict consumer dissatisfaction. The entire group of food products of one or more images is given an overall appearance score and each individual food product is also scored such that each may be ranked from least to more acceptable. The ranked food products can then be ejected in the order of worst to better rank to increase the overall quality score of the entire group.