A smart dandruff analysis system and method are provided for analyzing a severity of a subject's dandruff, and the smart dandruff analysis system has operation module, first neural network module, second neural network module, and classification module. The operation module receives a scalp area image of the subject and transforms the scalp area image into a first feature map. The first neural network module, a Convolutional Neural Network model, electrically connects with the operation module for receiving and transforming the scalp area image into a second feature map. The second neural network module, a Transformer model, electrically connecting with the first neural network module for receiving and transforming the second feature map into a third feature map. The classification module electrically connects with the second neural network module for receiving the third feature map and outputting a rating, wherein the rating is to determine the severity of the subject's dandruff.