公开(公告)号：US20220004803A1

公开(公告)日：2022-01-06

申请号：US17361779

申请日：2021-06-29

Applicant: L'Oreal

Inventor： Zeqi Li ,  Ruowei Jiang ,  Parham Aarabi

IPC: G06K9/62 ,  G06N3/04 ,  G06N5/02 ,  G06T19/00 ,  G06Q30/06

Abstract: GANs based generators are useful to perform image to image translations. GANs models have large storage sizes and resource use requirements such that they are too large to be deployed directly on mobile devices. Systems and methods define through conditioning a student GANs model having a student generator that is scaled downwardly from a teacher GANs model (and generator) using knowledge distillation. A semantic relation knowledge distillation loss is used to transfer semantic knowledge from an intermediate layer of the teacher to an intermediate layer of the student. Student generators thus defined are stored and executed by mobile devices such as smartphones and laptops to provide augmented reality experiences. Effects are simulated on images, including makeup, hair, nail and age simulation effects.

公开(公告)号：US20200342209A1

公开(公告)日：2020-10-29

申请号：US16854993

申请日：2020-04-22

Applicant: L'Oreal

Inventor： Tian Xing LI ,  Zhi Yu ,  Irina Kezele ,  Edmund Phung ,  Parham Aarabi

IPC: G06K9/00 ,  G06T7/11 ,  G06T7/143 ,  G06T5/20 ,  G06T19/00 ,  G06N3/04 ,  G06N3/08

Abstract: There are provided systems and methods for facial landmark detection using a convolutional neural network (CNN). The CNN comprises a first stage and a second stage where the first stage produces initial heat maps for the landmarks and initial respective locations for the landmarks. The second stage processes the heat maps and performs Region of Interest-based pooling while preserving feature alignment to produce cropped features. Finally, the second stage predicts from the cropped features a respective refinement location offset to each respective initial location. Combining each respective initial location with its respective refinement location offset provides a respective final coordinate (x,y) for each respective landmark in the image. Two-stage localization design helps to achieve fine-level alignment while remaining computationally efficient. The resulting architecture is both small enough in size and inference time to be suitable for real-time web applications such as product simulation and virtual reality.

公开(公告)号：US11978242B2

公开(公告)日：2024-05-07

申请号：US17361743

申请日：2021-06-29

Applicant: L'Oreal

Inventor： Zhi Yu ,  Yuze Zhang ,  Ruowei Jiang ,  Jeffrey Houghton ,  Parham Aarabi ,  Frederic Antoinin Raymond Serge Flament

IPC: G06K9/46 ,  G06K9/62 ,  G06N3/04 ,  G06Q30/0601 ,  G06V10/764 ,  G06V10/82 ,  G06V40/16

CPC classification number: G06V10/764 ,  G06N3/04 ,  G06Q30/0631 ,  G06Q30/0643 ,  G06V10/82 ,  G06V40/162 ,  G06V40/168 ,  G06V40/171 ,  G06V40/172

Abstract: There is described a deep learning supervised regression based model including methods and systems for facial attribute prediction and use thereof. An example of use is an augmented and/or virtual reality interface to provide a modified image responsive to facial attribute predictions determined from the image. Facial effects matching facial attributes are selected to be applied in the interface.

公开(公告)号：US11775056B2

公开(公告)日：2023-10-03

申请号：US17093844

申请日：2020-11-10

Applicant: L'Oreal

Inventor： Alex Levinshtein ,  Edmund Phung ,  Parham Aarabi

IPC: G06T7/73 ,  G06V10/766 ,  G06F3/01 ,  G06V40/19 ,  G06V40/16 ,  G06V40/18 ,  G06F18/21 ,  G06F18/243 ,  G06V10/764

CPC classification number: G06F3/012 ,  G06F3/013 ,  G06F18/217 ,  G06F18/24323 ,  G06T7/73 ,  G06V10/764 ,  G06V10/766 ,  G06V40/168 ,  G06V40/19 ,  G06V40/193 ,  G06V40/197 ,  G06T2207/10024 ,  G06T2207/20081 ,  G06T2207/30201

Abstract: This document relates to hybrid eye center localization using machine learning, namely cascaded regression and hand-crafted model fitting to improve a computer. There are proposed systems and methods of eye center (iris) detection using a cascade regressor (cascade of regression forests) as well as systems and methods for training a cascaded regressor. For detection, the eyes are detected using a facial feature alignment method. The robustness of localization is improved by using both advanced features and powerful regression machinery. Localization is made more accurate by adding a robust circle fitting post-processing step. Finally, using a simple hand-crafted method for eye center localization, there is provided a method to train the cascaded regressor without the need for manually annotated training data. Evaluation of the approach shows that it achieves state-of-the-art performance.

公开(公告)号：US11461931B2

公开(公告)日：2022-10-04

申请号：US16854975

申请日：2020-04-22

Applicant: L'Oreal

Inventor： Eric Elmoznino ,  Parham Aarabi ,  Yuze Zhang

IPC: G06T7/90 ,  G06T11/00 ,  G06N3/08 ,  G06Q30/06

Abstract: Provided are systems and methods to perform colour extraction from swatch images and to define new images using extracted colours. Source images may be classified using a deep learning net (e.g. a CNN) to indicate colour representation strength and drive colour extraction. A clustering classifier is trained to use feature vectors extracted by the net. Separately, pixel clustering is useful when extracting the colour. Cluster count can vary according to classification. In another manner, heuristics (with or without classification) are useful when extracting. Resultant clusters are evaluated against a set of (ordered) expected colours to determine a match. Instances of standardized swatch images may be defined from a template swatch image and respective extracted colours using image processing. The extracted colour may be presented in an augmented reality GUI such as a virtual try-on application and applied to a user image such as a selfie using image processing.

公开(公告)号：US11410314B2

公开(公告)日：2022-08-09

申请号：US16861368

申请日：2020-04-29

Applicant: L'Oreal

Inventor： Brendan Duke ,  Abdalla Ahmed ,  Edmund Phung ,  Irina Kezele ,  Parham Aarabi

IPC: G06T7/11 ,  G06K9/62 ,  G06T11/00 ,  G06T3/40 ,  G06T11/60 ,  G06T7/73 ,  G06T7/246 ,  G06N3/04 ,  G06N3/08 ,  G06T7/194

Abstract: Presented is a convolutional neural network (CNN) model for fingernail tracking, and a method design for nail polish rendering. Using current software and hardware, the CNN model and method to render nail polish runs in real-time on both iOS and web platforms. A use of Loss Mean Pooling (LMP) coupled with a cascaded model architecture simultaneously enables pixel-accurate fingernail predictions at up to 640×480 resolution. The proposed post-processing and rendering method takes advantage of the model's multiple output predictions to render gradients on individual fingernails, and to hide the light-colored distal edge when rendering on top of natural fingernails by stretching the nail mask in the direction of the fingernail tip. Teachings herein may be applied to track objects other than fingernails and to apply appearance effects other than color.

公开(公告)号：US20210056360A1

公开(公告)日：2021-02-25

申请号：US17093844

申请日：2020-11-10

Applicant: L'Oreal

Inventor： Alex Levinshtein ,  Edmund Phung ,  Parham Aarabi

IPC: G06K9/62 ,  G06K9/00 ,  G06T7/73 ,  G06F3/01

Abstract: This document relates to hybrid eye center localization using machine learning, namely cascaded regression and hand-crafted model fitting to improve a computer. There are proposed systems and methods of eye center (iris) detection using a cascade regressor (cascade of regression forests) as well as systems and methods for training a cascaded regressor. For detection, the eyes are detected using a facial feature alignment method. The robustness of localization is improved by using both advanced features and powerful regression machinery. Localization is made more accurate by adding a robust circle fitting post-processing step. Finally, using a simple hand-crafted method for eye center localization, there is provided a method to train the cascaded regressor without the need for manually annotated training data. Evaluation of the approach shows that it achieves state-of-the-art performance.

公开(公告)号：US10892166B2

公开(公告)日：2021-01-12

申请号：US16588723

申请日：2019-09-30

Applicant: L'Oreal

Inventor： Parham Aarabi

IPC: G06T11/00 ,  H01L21/308 ,  H01L21/268 ,  G03F7/20 ,  G03F1/50 ,  G03F1/54

Abstract: A computer-implemented method for correcting a makeup or skin effect to be rendered on a surface region of an image of a portion of a body of a person. The method and system correcting the makeup or skin effect by accounting for image-specific light field parameters, such as a light profile estimate and minimum light field estimation, and rendering the corrected the makeup or skin effect on the image to generate a corrected image.

公开(公告)号：US10565741B2

公开(公告)日：2020-02-18

申请号：US15425326

申请日：2017-02-06

Applicant: L'OREAL

Inventor： Parham Aarabi

IPC: G06T11/00 ,  G06K9/00 ,  G06T7/90 ,  G06T5/00

Abstract: A computer-implemented method for correcting a makeup or skin effect to be rendered on a surface region of an image of a portion of a body of a person. The method and system correcting the makeup or skin effect by accounting for image-specific light field parameters, such as a light profile estimate and minimum light field estimation, and rendering the corrected the makeup or skin effect on the image to generate a corrected image.