-
公开(公告)号:US10861211B2
公开(公告)日:2020-12-08
申请号:US16025793
申请日:2018-07-02
Applicant: Apple Inc.
Inventor: Thibaut Weise , Sofien Bouaziz , Hao Li , Mark Pauly
Abstract: A method of animating a digital character according to facial expressions of a user, comprising the steps of, (a) obtaining a 2D image and 3D depth map of the face of the user, (b) determining expression parameters for a user expression model so that a facial expression of the user-specific expression model represents the face of the user shown in the 2D image and 3D depth map (c) using the expression parameters and an animation prior to determine animation parameters usable to animate a digital character, wherein the animation prior is a sequence of animation parameters which represent predefined animations of a digital character (d) using the animation parameters to animate a digital character so that the digital character mimics the face of the user.
-
公开(公告)号:US20240430561A1
公开(公告)日:2024-12-26
申请号:US18662980
申请日:2024-05-13
Applicant: Apple Inc.
Inventor: Michael J. Rockwell , Oriel Y. Bergig , Geoffrey Stahl , Thibaut Weise , Peter Kaufmann , Branko Petljanski , Jason L. Slupeiks , Tom Sengelaub , Kathrin Berkner Cieslicki , Yanghai Tsin , Hesam Najafi , Arthur Y. Zhang , Cheng Chen , Graham B. Myhre , Fletcher R. Rothkopf , Marinus Meursing , Phil M. Hobson , Jason C. Sauers , Jan K. Quijalvo , Jia Tao , Ivan S. Maric , Jeremy C. Franklin , Wey-Jiun Lin , William A. Sorrentino, III , Jonathan Ive , Alan C. Dye , Stephen O. Lemay
IPC: H04N23/611 , G06F1/16 , G06F3/01 , H04N23/90
Abstract: A head-mountable display device includes a housing defining a front opening and a rear opening, a display screen disposed in the front opening, a display assembly disposed in the rear opening, a first securement strap coupled to the housing, the first securement strap including a first electronic component, a second securement strap coupled to the housing, the second securement strap including a second electronic component, and a securement band extending between and coupled to the first securement strap and the second securement strap.
-
公开(公告)号:US20240386819A1
公开(公告)日:2024-11-21
申请号:US18662883
申请日:2024-05-13
Applicant: Apple Inc.
Inventor: Michael J. Rockwell , Oriel Y. Bergig , Geoffrey Stahl , Thibaut Weise , Peter Kaufmann , Branko Petljanski , Jason L. Slupeiks , Tom Sengelaub , Kathrin Berkner Cieslicki , Yanghai Tsin , Hesam Najafi , Arthur Y. Zhang , Julian Hoenig , Julian Jaede , Yoonhoo Jo , Forrest C. Wang , Bertrand Nepveu , Muhammad F. Hossain , William A. Sorrentino, III , Jonathan Ive , Alan C. Dye , Stephen O. Lemay , Jeffrey M. Faulkner
IPC: G09G3/00 , G06F1/16 , G06F3/01 , G06F3/02 , G06F3/0362
Abstract: A head-mountable display device includes a housing defining a front opening and a rear opening, a display screen disposed in the front opening, a display assembly disposed in the rear opening, a first securement strap coupled to the housing, the first securement strap including a first electronic component, a second securement strap coupled to the housing, the second securement strap including a second electronic component, and a securement band extending between and coupled to the first securement strap and the second securement strap.
-
公开(公告)号:US20230343013A1
公开(公告)日:2023-10-26
申请号:US18314604
申请日:2023-05-09
Applicant: Apple Inc.
Inventor: Thibaut Weise , Sofien Bouaziz , Hao Li , Mark Pauly
IPC: G06T13/40 , G06V10/764 , G06V10/77 , G06V40/16
CPC classification number: G06T13/40 , G06V10/764 , G06F18/2415 , G06V10/7715 , G06V40/176 , G06F18/2135
Abstract: A method of animating a digital character according to facial expressions of a user, comprising the steps of, (a) obtaining a 2D image and 3D depth map of the face of the user, (b) determining expression parameters for a user expression model so that a facial expression of the user-specific expression model represents the face of the user shown in the 2D image and 3D depth map (c) using the expression parameters and an animation prior to determine animation parameters usable to animate a digital character, wherein the animation prior is a sequence of animation parameters which represent predefined animations of a digital character (d) using the animation parameters to animate a digital character so that the digital character mimics the face of the user.
-
公开(公告)号:US20240411361A1
公开(公告)日:2024-12-12
申请号:US18662964
申请日:2024-05-13
Applicant: Apple Inc.
Inventor: Michael J. Rockwell , Oriel Y. Bergig , Geoffrey Stahl , Thibaut Weise , Peter Kaufmann , Branko Petljanski , Jason L. Slupeiks , Tom Sengelaub , Yanghai Tsin , Hesam Najafi , Arthur Y. Zhang , Cheng Chen , Graham B. Myhre , Fletcher R. Rothkopf , Marinus Meursing , Phil M. Hobson , Jason C. Sauers , Jan K. Quijalvo , Jia Tao , Ivan S. Maric , Jeremy C. Franklin , Wey-Jiun Lin
IPC: G06F3/01
Abstract: A head-mountable display device includes a housing defining a front opening and a rear opening, a display screen disposed in the front opening, a display assembly disposed in the rear opening, a first securement strap coupled to the housing, the first securement strap including a first electronic component, a second securement strap coupled to the housing, the second securement strap including a second electronic component, and a securement band extending between and coupled to the first securement strap and the second securement strap.
-
公开(公告)号:US10452896B1
公开(公告)日:2019-10-22
申请号:US15697208
申请日:2017-09-06
Applicant: Apple, Inc.
Inventor: Thibaut Weise , Sofien Bouaziz , Atulit Kumar , Sarah Amsellem
Abstract: Techniques are disclosed for creating avatars from image data of a person. According to these techniques, spatial facial attributes of a subject may be measured from an image representing the subject. The measured facial attributes may be matching to a three-dimensional avatar template. Other attributes of the subject may be identified, such as hair type, hair color, eye color, skin color and the like. For hair type, hair may be generated for the avatar by measuring spatial locations of hair of the subject and the measured hair locations may be compared to locations of hair represented by a plurality of hair templates. A matching hair template may be selected from the plurality of hair templates, which may be used in generating the avatar. An avatar may be generated from the matching avatar template, which may be deformed according to the measured spatial facial attributes, and from the other attributes.
-
公开(公告)号:US20190180084A1
公开(公告)日:2019-06-13
申请号:US15934521
申请日:2018-03-23
Applicant: Apple Inc.
Inventor: Sofien Bouaziz , Brian Amberg , Thibaut Weise , Patrick Snape , Stefan Brugger , Alex Mansfield , Reinhard Knothe , Thomas Kiser
CPC classification number: G06K9/00281 , G06K9/00261 , G06K9/00315 , G06T17/20
Abstract: A three-dimensional model (e.g., motion capture model) of a user is generated from captured images or captured video of the user. A machine learning network may track poses and expressions of the user to generate and refine the three-dimensional model. Refinement of the three-dimensional model may provide more accurate tracking of the user's face. Refining of the three-dimensional model may include refining the determinations of poses and expressions at defined locations (e.g., eye corners and/or nose) in the three-dimensional model. The refining may occur in an iterative process. Tracking of the three-dimensional model over time (e.g., during video capture) may be used to generate an animated three-dimensional model (e.g., an animated puppet) of the user that simulates the user's poses and expressions.
-
公开(公告)号:US10210648B2
公开(公告)日:2019-02-19
申请号:US15809875
申请日:2017-11-10
Applicant: Apple Inc.
Inventor: Justin D. Stoyles , Alexandre R. Moha , Nicolas V. Scapel , Guillaume P. Barlier , Aurelio Guzman , Bruno M. Sommer , Nina Damasky , Thibaut Weise , Thomas Goossens , Hoan Pham , Brian Amberg
Abstract: Systems and methods for generating a video of an emoji that has been puppeted using inputs from image, depth, and audio. The inputs can capture facial expressions of a user, eye, eyebrow, mouth, and head movements. A pose, held by the user, can be detected that can be used to generate supplemental animation. The emoji can further be animated using physical properties associated with the emoji and captured movements. An emoji of a dog can have its ears move in response to an up-and-down movement, or a shaking of the head. The video can be sent in a message to one or more recipients. A sending device can render the puppeted video in accordance with hardware and software capabilities of a recipient's computer device.
-
公开(公告)号:US20180089880A1
公开(公告)日:2018-03-29
申请号:US15712683
申请日:2017-09-22
Applicant: Apple Inc.
Inventor: Christopher M. Garrido , Brian Amberg , David L. Biderman , Eric L. Chien , Haitao Guo , Sarah Amsellem , Thibaut Weise , Timothy L. Bienz
CPC classification number: G06T13/80 , H04L65/4069 , H04L65/601 , H04L65/605 , H04L65/80 , H04N7/147 , H04N7/15 , H04N7/157 , H04N21/4223 , H04N21/44209 , H04N21/44245 , H04N21/4532 , H04N21/4788 , H04N2007/145
Abstract: In an embodiment a method of online video communication is disclosed. An online video communication is established between a source device and a receiving device. The source device captures a live video recording of a sending user. The captured recording is analyzed to identify one or more characteristics of the sending user. The source device then generates avatar data corresponding to the identified characteristics. The avatar data is categorized into a plurality of groups, wherein a first group of the at least two groups comprises avatar data that is more unique to the sending user. Finally, at least the first group of the plurality of groups is transmitted to the receiving device. The transmitted first group of avatar data defines, at least in part, how to animate an avatar that mimics the sending user's one or more physical characteristics.
-
公开(公告)号:US20240397032A1
公开(公告)日:2024-11-28
申请号:US18662826
申请日:2024-05-13
Applicant: Apple Inc.
Inventor: Michael J. Rockwell , Oriel Y. Bergig , Geoffrey Stahl , Thibaut Weise , Peter Kaufmann , Branko Petljanski , Jason L. Slupeiks , Tom Sengelaub , Kathrin Berkner Cieslicki , Yanghai Tsin , Hesam Najafi , Arthur Y. Zhang , Cheng Chen , Graham B. Myhre , Fletcher R. Rothkopf , Marinus Meursing , Phil M. Hobson , Jason C. Sauers , Jan K. Quijalvo , Jia Tao , Ivan S. Maric , Jeremy C. Franklin , Wey-Jiun Lin , Muhammad F. Hossain
IPC: H04N13/361 , G06F3/01 , H04N13/204 , H04N13/344 , H04N13/383
Abstract: A head-mountable display device includes a housing defining a front opening and a rear opening, a display screen disposed in the front opening, a display assembly disposed in the rear opening, a first securement strap coupled to the housing, the first securement strap including a first electronic component, a second securement strap coupled to the housing, the second securement strap including a second electronic component, and a securement band extending between and coupled to the first securement strap and the second securement strap.
-
-
-
-
-
-
-
-
-