A system and method for determining color variants of a fashion product is provided. A system for determining a color variant of a fashion product is provided. The system comprises a categorization module configured to receive a plurality of images corresponding to a plurality of fashion products and configured to categorize the plurality of images into a plurality of styles. The system further includes a color variant determination module configured to compute a plurality of embeddings for the corresponding plurality of images, compute a mean value for the plurality of embeddings and compare each embedding to one or more predefined constraints to determine whether the embedding belongs to a color variant set.