Computer vision grouping recognition is provided by receiving training images that include unpackaged items; identifying, by a computer vision model, a candidate identities for unpackaged items in a given training image; receiving, from a human user, a selected identity for the unpackaged item as feedback for the candidate identity; constructing a confusion matrix tallying matches and mismatches between candidate identities and the selected identities as analyzed across the training images for each unpackaged item; identifying at least one product category that includes at least a first unpackaged item and a second unpackaged item that the confusion matrix indicates as being misidentified for each other by the computer vision model; and reconfiguring the computer vision model to identify the product category instead of the first unpackaged item or the second unpackaged item when analyzing a given image including one or more of the first unpackaged item or the second unpackaged item.