-
公开(公告)号:US11645497B2
公开(公告)日:2023-05-09
申请号:US16683398
申请日:2019-11-14
Applicant: L'Oreal
Inventor: Eric Elmoznino , He Ma , Irina Kezele , Edmund Phung , Alex Levinshtein , Parham Aarabi
CPC classification number: G06N3/045 , G06F3/011 , G06N3/047 , G06N3/08 , G06N20/00 , G06T19/006 , G06T2207/20081
Abstract: Systems and methods relate to a network model to apply an effect to an image such as an augmented reality effect (e.g. makeup, hair, nail, etc.). The network model uses a conditional cycle-consistent generative image-to-image translation model to translate images from a first domain space where the effect is not applied and to a second continuous domain space where the effect is applied. In order to render arbitrary effects (e.g. lipsticks) not seen at training time, the effect's space is represented as a continuous domain (e.g. a conditional variable vector) learned by encoding simple swatch images of the effect, such as are available as product swatches, as well as a null effect. The model is trained end-to-end in an unsupervised fashion. To condition a generator of the model, convolutional conditional batch normalization (CCBN) is used to apply the vector encoding the reference swatch images that represent the makeup properties.
-
公开(公告)号:US11553872B2
公开(公告)日:2023-01-17
申请号:US16702895
申请日:2019-12-04
Applicant: L'OREAL
Inventor: Ruowei Jiang , Junwei Ma , He Ma , Eric Elmoznino , Irina Kezele , Alex Levinshtein , Julien Despois , Matthieu Perrot , Frederic Antoinin Raymond Serge Flament , Parham Aarabi
Abstract: There is shown and described a deep learning based system and method for skin diagnostics as well as testing metrics that show that such a deep learning based system outperforms human experts on the task of apparent skin diagnostics. Also shown and described is a system and method of monitoring a skin treatment regime using a deep learning based system and method for skin diagnostics.
-
公开(公告)号:US11775056B2
公开(公告)日:2023-10-03
申请号:US17093844
申请日:2020-11-10
Applicant: L'Oreal
Inventor: Alex Levinshtein , Edmund Phung , Parham Aarabi
IPC: G06T7/73 , G06V10/766 , G06F3/01 , G06V40/19 , G06V40/16 , G06V40/18 , G06F18/21 , G06F18/243 , G06V10/764
CPC classification number: G06F3/012 , G06F3/013 , G06F18/217 , G06F18/24323 , G06T7/73 , G06V10/764 , G06V10/766 , G06V40/168 , G06V40/19 , G06V40/193 , G06V40/197 , G06T2207/10024 , G06T2207/20081 , G06T2207/30201
Abstract: This document relates to hybrid eye center localization using machine learning, namely cascaded regression and hand-crafted model fitting to improve a computer. There are proposed systems and methods of eye center (iris) detection using a cascade regressor (cascade of regression forests) as well as systems and methods for training a cascaded regressor. For detection, the eyes are detected using a facial feature alignment method. The robustness of localization is improved by using both advanced features and powerful regression machinery. Localization is made more accurate by adding a robust circle fitting post-processing step. Finally, using a simple hand-crafted method for eye center localization, there is provided a method to train the cascaded regressor without the need for manually annotated training data. Evaluation of the approach shows that it achieves state-of-the-art performance.
-
公开(公告)号:US20210056360A1
公开(公告)日:2021-02-25
申请号:US17093844
申请日:2020-11-10
Applicant: L'Oreal
Inventor: Alex Levinshtein , Edmund Phung , Parham Aarabi
Abstract: This document relates to hybrid eye center localization using machine learning, namely cascaded regression and hand-crafted model fitting to improve a computer. There are proposed systems and methods of eye center (iris) detection using a cascade regressor (cascade of regression forests) as well as systems and methods for training a cascaded regressor. For detection, the eyes are detected using a facial feature alignment method. The robustness of localization is improved by using both advanced features and powerful regression machinery. Localization is made more accurate by adding a robust circle fitting post-processing step. Finally, using a simple hand-crafted method for eye center localization, there is provided a method to train the cascaded regressor without the need for manually annotated training data. Evaluation of the approach shows that it achieves state-of-the-art performance.
-
公开(公告)号:US11832958B2
公开(公告)日:2023-12-05
申请号:US18080331
申请日:2022-12-13
Applicant: L'OREAL
Inventor: Ruowei Jiang , Junwei Ma , He Ma , Eric Elmoznino , Irina Kezele , Alex Levinshtein , Julien Despois , Matthieu Perrot , Frederic Antoinin Raymond Serge Flament , Parham Aarabi
CPC classification number: A61B5/441 , G06N3/045 , G06N3/08 , G06T7/0012 , G06V10/454 , G06V10/82 , G06V40/171 , G06T2207/30088 , G06V40/174 , G06V40/18
Abstract: There is shown and described a deep learning based system and method for skin diagnostics as well as testing metrics that show that such a deep learning based system outperforms human experts on the task of apparent skin diagnostics. Also shown and described is a system and method of monitoring a skin treatment regime using a deep learning based system and method for skin diagnostics.
-
公开(公告)号:US11861497B2
公开(公告)日:2024-01-02
申请号:US17565581
申请日:2021-12-30
Applicant: L'OREAL
Inventor: Alex Levinshtein , Cheng Chang , Edmund Phung , Irina Kezele , Wenzhangzhi Guo , Eric Elmoznino , Ruowei Jiang , Parham Aarabi
IPC: G06N3/08 , G06T7/11 , G06T7/90 , G06T1/20 , G06T11/00 , G06V10/44 , G06V40/16 , G06F18/21 , G06F18/24 , G06V10/82
CPC classification number: G06N3/08 , G06F18/21 , G06F18/24 , G06T1/20 , G06T7/11 , G06T7/90 , G06T11/001 , G06V10/454 , G06V10/82 , G06V40/165 , G06V40/171 , G06T2200/24 , G06T2207/10016 , G06T2207/10024 , G06T2207/20081 , G06T2207/20084
Abstract: A system and method implement deep learning on a mobile device to provide a convolutional neural network (CNN) for real time processing of video, for example, to color hair. Images are processed using the CNN to define a respective hair matte of hair pixels. The respective object mattes may be used to determine which pixels to adjust when adjusting pixel values such as to change color, lighting, texture, etc. The CNN may comprise a (pre-trained) network for image classification adapted to produce the segmentation mask. The CNN may be trained for image segmentation (e.g. using coarse segmentation data) to minimize a mask-image gradient consistency loss. The CNN may further use skip connections between corresponding layers of an encoder stage and a decoder stage where shallower layers in the encoder, which contain high-res but weak features are combined with low resolution but powerful features from deeper decoder layers.
-
公开(公告)号:US11216988B2
公开(公告)日:2022-01-04
申请号:US16753214
申请日:2018-10-24
Applicant: L'OREAL
Inventor: Alex Levinshtein , Cheng Chang , Edmund Phung , Irina Kezele , Wenzhangzhi Guo , Eric Elmoznino , Ruowei Jiang , Parham Aarabi
Abstract: A system and method implement deep learning on a mobile device to provide a convolutional neural network (CNN) for real time processing of video, for example, to color hair. Images are processed using the CNN to define a respective hair matte of hair pixels. The respective object mattes may be used to determine which pixels to adjust when adjusting pixel values such as to change color, lighting, texture, etc. The CNN may comprise a (pre-trained) network for image classification adapted to produce the segmentation mask. The CNN may be trained for image segmentation (e.g. using coarse segmentation data) to minimize a mask-image gradient consistency loss. The CNN may further use skip connections between corresponding layers of an encoder stage and a decoder stage where shallower layers in the encoder, which contain high-res but weak features are combined with low resolution but powerful features from deeper decoder layers.
-
-
-
-
-
-