公开(公告)号：US11908128B2

公开(公告)日：2024-02-20

申请号：US16996087

申请日：2020-08-18

Applicant: L'Oreal

Inventor： Ruowei Jiang ,  Irina Kezele ,  Zhi Yu ,  Sophie Seite ,  Frederic Antoinin Raymond Serge Flament ,  Parham Aarabi ,  Mathieu Perrot ,  Julien Despois

IPC: G06T7/00 ,  A61B5/00 ,  G16H50/20 ,  G06Q30/0601

CPC classification number: G06T7/0012 ,  A61B5/0077 ,  A61B5/441 ,  A61B5/7267 ,  G06Q30/0631 ,  G06Q30/0633 ,  G06Q30/0641 ,  G16H50/20 ,  G06T2207/20076 ,  G06T2207/20081 ,  G06T2207/20084 ,  G06T2207/30088 ,  G06T2207/30201

Abstract: Systems and methods process images to determine a skin condition severity analysis and to visualize a skin analysis such as using a deep neural network (e.g. a convolutional neural network) where a problem was formulated as a regression task with integer-only labels. Auxiliary classification tasks (for example, comprising gender and ethnicity predictions) are introduced to improve performance. Scoring and other image processing techniques may be used (e.g. in assoc. with the model) to visualize results such as highlighting the analyzed image. It is demonstrated that the visualization of results, which highlight skin condition affected areas, can also provide perspicuous explanations for the model. A plurality (k) of data augmentations may be made to a source image to yield k augmented images for processing. Activation masks (e.g. heatmaps) produced from processing the k augmented images are used to define a final map to visualize the skin analysis.