公开(公告)号：US11978242B2

公开(公告)日：2024-05-07

申请号：US17361743

申请日：2021-06-29

Applicant: L'Oreal

Inventor： Zhi Yu ,  Yuze Zhang ,  Ruowei Jiang ,  Jeffrey Houghton ,  Parham Aarabi ,  Frederic Antoinin Raymond Serge Flament

IPC: G06K9/46 ,  G06K9/62 ,  G06N3/04 ,  G06Q30/0601 ,  G06V10/764 ,  G06V10/82 ,  G06V40/16

CPC classification number: G06V10/764 ,  G06N3/04 ,  G06Q30/0631 ,  G06Q30/0643 ,  G06V10/82 ,  G06V40/162 ,  G06V40/168 ,  G06V40/171 ,  G06V40/172

Abstract: There is described a deep learning supervised regression based model including methods and systems for facial attribute prediction and use thereof. An example of use is an augmented and/or virtual reality interface to provide a modified image responsive to facial attribute predictions determined from the image. Facial effects matching facial attributes are selected to be applied in the interface.

公开(公告)号：US12190637B2

公开(公告)日：2025-01-07

申请号：US17558955

申请日：2021-12-22

Applicant: L'Oreal

Inventor： Zeqi Li ,  Ruowei Jiang ,  Parham Aarabi

IPC: G06T11/00 ,  G06N3/08 ,  G06Q30/0601 ,  G06V10/77 ,  G06V40/16

Abstract: There is provided methods, devices and techniques to process an image using a deep learning model to achieve continuous effect simulation by a unified network where a simple (effect class) estimator is embedded into a regular encoder-decoder architecture. The estimator allows learning of model-estimated class embeddings of all effect classes (e.g. progressive degrees of the effect), thus representing the continuous effect information without manual efforts in selecting proper anchor effect groups. In an embodiment, given a target age class, there is derived a personalized age embedding which considers two aspects of face aging: 1) a personalized residual age embedding at a model-estimated age of the subject, preserving the subject's aging information; and 2) exemplar-face aging basis at the target age, encoding the shared aging patterns among the entire population. Training and runtime (inference time) embodiments are described including an AR application that generates recommendations and provides ecommerce services.

公开(公告)号：US11908128B2

公开(公告)日：2024-02-20

申请号：US16996087

申请日：2020-08-18

Applicant: L'Oreal

Inventor： Ruowei Jiang ,  Irina Kezele ,  Zhi Yu ,  Sophie Seite ,  Frederic Antoinin Raymond Serge Flament ,  Parham Aarabi ,  Mathieu Perrot ,  Julien Despois

IPC: G06T7/00 ,  A61B5/00 ,  G16H50/20 ,  G06Q30/0601

CPC classification number: G06T7/0012 ,  A61B5/0077 ,  A61B5/441 ,  A61B5/7267 ,  G06Q30/0631 ,  G06Q30/0633 ,  G06Q30/0641 ,  G16H50/20 ,  G06T2207/20076 ,  G06T2207/20081 ,  G06T2207/20084 ,  G06T2207/30088 ,  G06T2207/30201

Abstract: Systems and methods process images to determine a skin condition severity analysis and to visualize a skin analysis such as using a deep neural network (e.g. a convolutional neural network) where a problem was formulated as a regression task with integer-only labels. Auxiliary classification tasks (for example, comprising gender and ethnicity predictions) are introduced to improve performance. Scoring and other image processing techniques may be used (e.g. in assoc. with the model) to visualize results such as highlighting the analyzed image. It is demonstrated that the visualization of results, which highlight skin condition affected areas, can also provide perspicuous explanations for the model. A plurality (k) of data augmentations may be made to a source image to yield k augmented images for processing. Activation masks (e.g. heatmaps) produced from processing the k augmented images are used to define a final map to visualize the skin analysis.

公开(公告)号：US11553872B2

公开(公告)日：2023-01-17

申请号：US16702895

申请日：2019-12-04

Applicant: L'OREAL

Inventor： Ruowei Jiang ,  Junwei Ma ,  He Ma ,  Eric Elmoznino ,  Irina Kezele ,  Alex Levinshtein ,  Julien Despois ,  Matthieu Perrot ,  Frederic Antoinin Raymond Serge Flament ,  Parham Aarabi

IPC: G06V40/16 ,  A61B5/00 ,  G06T7/00 ,  G06N3/04 ,  G06N3/08 ,  G06V10/82 ,  G06V40/18

Abstract: There is shown and described a deep learning based system and method for skin diagnostics as well as testing metrics that show that such a deep learning based system outperforms human experts on the task of apparent skin diagnostics. Also shown and described is a system and method of monitoring a skin treatment regime using a deep learning based system and method for skin diagnostics.

公开(公告)号：US20220004803A1

公开(公告)日：2022-01-06

申请号：US17361779

申请日：2021-06-29

Applicant: L'Oreal

Inventor： Zeqi Li ,  Ruowei Jiang ,  Parham Aarabi

IPC: G06K9/62 ,  G06N3/04 ,  G06N5/02 ,  G06T19/00 ,  G06Q30/06

Abstract: GANs based generators are useful to perform image to image translations. GANs models have large storage sizes and resource use requirements such that they are too large to be deployed directly on mobile devices. Systems and methods define through conditioning a student GANs model having a student generator that is scaled downwardly from a teacher GANs model (and generator) using knowledge distillation. A semantic relation knowledge distillation loss is used to transfer semantic knowledge from an intermediate layer of the teacher to an intermediate layer of the student. Student generators thus defined are stored and executed by mobile devices such as smartphones and laptops to provide augmented reality experiences. Effects are simulated on images, including makeup, hair, nail and age simulation effects.

公开(公告)号：US20240268541A1

公开(公告)日：2024-08-15

申请号：US18568119

申请日：2022-05-09

Applicant: L'Oreal

Inventor： Sileye Ba ,  Ruowei Jiang ,  Robin Kips

IPC: A45D44/00 ,  G06T15/20 ,  G06V10/82

CPC classification number: A45D44/005 ,  G06T15/205 ,  G06V10/82

Abstract: According to one aspect, what is proposed is a method for generating a photorealistic rendering of a cosmetic product, comprising: —obtaining (10, 12) a reference image (Xref) of a real cosmetic product (PC) applied to a first person (P1) and at least one source image (Xjsource) of a second person (P2), —implementing (13) an encoding artificial neural network (E) configured to determine characterizing parameters (E(Xref)) of the cosmetic product (PC) from the reference image (Xref), and then —implementing (14) a realistic physically based rendering engine (R) configured to generate a transformed image (R (Xjsource, E(Xref))) in which a photorealistic rendering of the cosmetic product (PC) is applied to the person (P2) from said at least one source image (Xjsource) based on the characterizing parameters (E (Xref)) of the cosmetic product (PC) that are determined by the encoding artificial neural network (E).

公开(公告)号：US11832958B2

公开(公告)日：2023-12-05

申请号：US18080331

申请日：2022-12-13

Applicant: L'OREAL

Inventor： Ruowei Jiang ,  Junwei Ma ,  He Ma ,  Eric Elmoznino ,  Irina Kezele ,  Alex Levinshtein ,  Julien Despois ,  Matthieu Perrot ,  Frederic Antoinin Raymond Serge Flament ,  Parham Aarabi

IPC: A61B5/00 ,  G06T7/00 ,  G06V40/16 ,  G06N3/08 ,  G06V10/82 ,  G06N3/045 ,  G06V10/44 ,  G06V40/18

CPC classification number: A61B5/441 ,  G06N3/045 ,  G06N3/08 ,  G06T7/0012 ,  G06V10/454 ,  G06V10/82 ,  G06V40/171 ,  G06T2207/30088 ,  G06V40/174 ,  G06V40/18

Abstract: There is shown and described a deep learning based system and method for skin diagnostics as well as testing metrics that show that such a deep learning based system outperforms human experts on the task of apparent skin diagnostics. Also shown and described is a system and method of monitoring a skin treatment regime using a deep learning based system and method for skin diagnostics.

公开(公告)号：US20220198830A1

公开(公告)日：2022-06-23

申请号：US17558955

申请日：2021-12-22

Applicant: L'Oreal

Inventor： Zeqi LI ,  Ruowei Jiang ,  Parham Aarabi

IPC: G06V40/16 ,  G06V10/77 ,  G06T11/00 ,  G06Q30/06

Abstract: There is provided methods, devices and techniques to process an image using a deep learning model to achieve continuous effect simulation by a unified network where a simple (effect class) estimator is embedded into a regular encoder-decoder architecture. The estimator allows learning of model-estimated class embeddings of all effect classes (e.g. progressive degrees of the effect), thus representing the continuous effect information without manual efforts in selecting proper anchor effect groups. In an embodiment, given a target age class, there is derived a personalized age embedding which considers two aspects of face aging: 1) a personalized residual age embedding at a model-estimated age of the subject, preserving the subject's aging information; and 2) exemplar-face aging basis at the target age, encoding the shared aging patterns among the entire population. Training and runtime (inference time) embodiments are described including an AR application that generates recommendations and provides ecommerce services.

公开(公告)号：US20220108445A1

公开(公告)日：2022-04-07

申请号：US17491623

申请日：2021-10-01

Applicant: L'Oreal

Inventor： Yuze ZHANG ,  Ruowei Jiang ,  Parham AARABI

IPC: G06T7/00 ,  A61B5/00

Abstract: Systems, methods and techniques provide for acne localization, counting and visualization. An image is processed using a trained model to identify objects. The model may be a deep learning (e.g. convolutional neural) network configured for object classification with a detection focus on small objects. The image may be a frontal or profile facial image, processed end to end. The model identifies and localizes different types of acne. Instances are counted and visualized such as by annotating the source image. An example annotation is an overlay identifying a type and location of each instance. Counts by acne type assist with scoring. A product and/or service may be recommended in response to the identification of the acne (e.g. the type, localization, counting and/or a score).

公开(公告)号：US12105773B2

公开(公告)日：2024-10-01

申请号：US17361779

申请日：2021-06-29

Applicant: L'Oreal

Inventor： Zeqi Li ,  Ruowei Jiang ,  Parham Aarabi

IPC: G06N5/02 ,  G06F18/22 ,  G06N3/04 ,  G06Q30/0601 ,  G06T19/00

CPC classification number: G06F18/22 ,  G06N3/04 ,  G06N5/02 ,  G06Q30/0631 ,  G06Q30/0643 ,  G06T19/006

Abstract: GANs based generators are useful to perform image to image translations. GANs models have large storage sizes and resource use requirements such that they are too large to be deployed directly on mobile devices. Systems and methods define through conditioning a student GANs model having a student generator that is scaled downwardly from a teacher GANs model (and generator) using knowledge distillation. A semantic relation knowledge distillation loss is used to transfer semantic knowledge from an intermediate layer of the teacher to an intermediate layer of the student. Student generators thus defined are stored and executed by mobile devices such as smartphones and laptops to provide augmented reality experiences. Effects are simulated on images, including makeup, hair, nail and age simulation effects.