-
公开(公告)号:WO2018128930A1
公开(公告)日:2018-07-12
申请号:PCT/US2017/068988
申请日:2017-12-29
Applicant: SNAP INC.
Inventor: EGRI, Ozi , EZRA, David Ben , MCPHEE, Andrew James , PAN, Qi , ZAK, Eyal , HARE, Samuel Edward , MURPHY, Robert Cornelius , SAGAR, Dhritiman , YU, Peicheng
Abstract: Among other things, embodiments of the present disclosure improve the functionality of computer imaging software and systems by facilitating the manipulation of virtual content displayed in conjunction with images of real-world objects and environments. Embodiments of the present disclosure allow different virtual objects to be moved onto different physical surfaces, as well as manipulated in other ways.
-
公开(公告)号:WO2021042134A1
公开(公告)日:2021-03-04
申请号:PCT/US2020/070480
申请日:2020-08-28
Applicant: SNAP INC.
Inventor: GOODRICH, Kyle , HARE, Samuel Edward , LAZAROV, Maxim Maximov , MATHEW, Tony , MCPHEE, Andrew James , MORENO, Daniel , SAGAR, Dhritiman , SHANG, Wentao
Abstract: The subject technology receives image data and depth data. The subject technology selects an augmented reality content generator corresponding to a three-dimensional (3D) effect. The subject technology applies the 3D effect to the image data and the depth data based at least in part on the selected augmented reality content generator. The subject technology generates, using a processor, a message including information related to the applied 3D effect, the image data, and the depth data.
-
公开(公告)号:WO2018081125A1
公开(公告)日:2018-05-03
申请号:PCT/US2017/058093
申请日:2017-10-24
Applicant: SNAP INC.
Inventor: HARE, Samuel Edward , MCPHEE, Andrew James , MURPHY, Robert Cornelius , SAGAR, Dhritiman , YU, Peicheng
Abstract: A redundant tracking system comprising multiple redundant tracking sub-systems, enabling seamless transitions between such tracking sub-systems, provides a solution to this problem by merging multiple tracking approaches into a single tracking system. This system is able to combine tracking objects with six degrees of freedom (6DoF) and 3DoF through combining and transitioning between multiple tracking systems based on the availability of tracking indicia tracked by the tracking systems. Thus, as the indicia tracked by any one tracking system becomes unavailable, the redundant tracking system seamlessly switches between tracking in 6DoF and 3DoF thereby providing the user with an uninterrupted experience.
Abstract translation: 包括多个冗余跟踪子系统的冗余跟踪系统实现了这些跟踪子系统之间的无缝过渡,通过将多个跟踪方法合并到单个跟踪系统中来为这个问题提供解决方案。 根据跟踪系统追踪的跟踪标记的可用性,该系统能够通过在多个跟踪系统之间进行组合和转换来将跟踪对象与六个自由度(6DoF)和3DoF进行组合。 因此,随着任何一个跟踪系统跟踪的标记变得不可用,冗余跟踪系统在6DoF和3DoF跟踪之间无缝切换,从而为用户提供不间断的体验。 p>
-
公开(公告)号:WO2021189068A1
公开(公告)日:2021-09-23
申请号:PCT/US2021/070259
申请日:2021-03-10
Applicant: SNAP INC.
Inventor: GOODRICH, Kyle , HARE, Samuel Edward , LAZAROV, Maxim Maximov , MATHEW, Tony , MCPHEE, Andrew James , MORENO, Daniel , SHANG, Wentao
Abstract: Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing at least one program and method for performing operations comprising: receiving, by a messaging application, an image generated by a camera of a user; displaying an option to crop an object depicted in the image; determining whether the object is depicted in the image; selectively enabling selection of the option to crop the object based on determining whether the object is depicted in the image; receiving input that selects the option to crop an object depicted in the image when the option is enabled; in response to receiving the input, segmenting the image to separate the object from other portions depicted in the image; extracting the object from the image; and adding the extracted object to a new image as a virtual object.
-
公开(公告)号:WO2021163725A1
公开(公告)日:2021-08-19
申请号:PCT/US2021/070142
申请日:2021-02-11
Applicant: SNAP INC.
Inventor: GOODRICH, Kyle , HARE, Samuel Edward , LAZAROV, Maxim Maximov , MATHEW, Tony , MCPHEE, Andrew James , MORENO, Daniel , SHANG, Wentao
Abstract: Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing at least one program and method for performing operations comprising: receiving, by a messaging application, an image from a camera of a user device; receiving input that selects a user-customizable effects option for activating a user-customizable effects mode; in response to receiving the input, displaying an array of a plurality of effect options together with the image proximate to the user-customizable effects option; and applying a first effect associated with a first effect option of the plurality of effect options to the image.
-
公开(公告)号:WO2019055822A1
公开(公告)日:2019-03-21
申请号:PCT/US2018/051141
申请日:2018-09-14
Applicant: SNAP INC.
Inventor: HARE, Samuel Edward , POLIAKOV, Fedir , WANG, Guohui , XIONG, Xuehan , YANG, Jianchao , YANG, Linjie , ANILKUMAR, Shah Tanmay
Abstract: A mobile device can generate real-time complex visual image effects using asynchronous processing pipeline. A first pipeline applies a complex image process, such as a neural network, to keyframes of a live image sequence. A second pipeline generates flow maps that describe feature transformations in the image sequence. The flow maps can be used to process non-keyframes on the fly. The processed keyframes and non-keyframes can be used to display a complex visual effect on the mobile device in real-time or near real-time.
-
公开(公告)号:WO2021212133A1
公开(公告)日:2021-10-21
申请号:PCT/US2021/070379
申请日:2021-04-13
Applicant: SNAP INC.
Inventor: GOODRICH, Kyle , HARE, Samuel Edward , LAZAROV, Maxim Maximov , MATHEW, Tony , MCPHEE, Andrew James , MORENO, Daniel , SHANG, Wentao
Abstract: The subject technology selects a set of augmented reality content generators from available augmented reality content generators, the selected set of augmented reality content generators comprising at least one augmented reality content generator for applying a three-dimensional (3D) effect. The subject technology causes display of a carousel interface including selectable graphical items, each selectable graphical item corresponding to a respective augmented reality content generator. The subject technology receives a selection of a first selectable graphical item from the selectable graphical items, the first selectable graphical item including a first augmented reality content generator for applying a first 3D effect. The subject technology applies, to first image data and first depth data, the first augmented reality content generator corresponding to the selected first selectable graphical item. The subject technology generates a message including the applied first augmented reality content generator to the first image data and the first depth data.
-
公开(公告)号:WO2020264551A3
公开(公告)日:2020-12-30
申请号:PCT/US2020/070158
申请日:2020-06-19
Applicant: SNAP INC.
Inventor: HARE, Samuel Edward , MCPHEE, Andrew James , LAZAROV, Maxim Maximov , SHANG, Wentao , GOODRICH, Kyle , MATHEW, Tony
Abstract: Systems and methods are provided for capturing by a camera of a user device, a first image depicting a first environment of the user device; overlaying a first virtual object on a portion of the first image depicting the first environment; modifying a surface of the first virtual object using content captured by the user device; storing a second virtual object comprising the first virtual object with the modified surface; and generating for display the second virtual object on a portion of a second image depicting a second environment.
-
公开(公告)号:WO2020047117A1
公开(公告)日:2020-03-05
申请号:PCT/US2019/048597
申请日:2019-08-28
Applicant: SNAP INC.
Inventor: HARE, Samuel Edward , MCPHEE, Andrew James , MATHEW, Tony
IPC: G06F3/0346 , G06F3/00 , G06T19/00 , H04N5/272
Abstract: Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing at least one program, and a method for rendering a three-dimensional virtual object in a video clip. The method and system include capturing, using a camera-enabled device, video content of a real-world scene and movement information collected by the camera-enabled device during capture of the video content. The captured video and movement information are stored. The stored captured video content is processed to identify a real-world object in the scene. An interactive augmented reality display is generated that: adds a virtual object to the stored video content to create augmented video content comprising the real-world scene and the virtual object; and adjusts, during playback of the augmented video content, an on-screen position of the virtual object within the augmented video content based at least in part on the stored movement information.
-
公开(公告)号:WO2020264551A2
公开(公告)日:2020-12-30
申请号:PCT/US2020/070158
申请日:2020-06-19
Applicant: SNAP INC.
Inventor: HARE, Samuel Edward , MCPHEE, Andrew James , LAZAROV, Maxim Maximov , SHANG, Wentao , GOODRICH, Kyle , MATHEW, Tony
Abstract: Systems and methods are provided for capturing by a camera of a user device, a first image depicting a first environment of the user device; overlaying a first virtual object on a portion of the first image depicting the first environment; modifying a surface of the first virtual object using content captured by the user device; storing a second virtual object comprising the first virtual object with the modified surface; and generating for display the second virtual object on a portion of a second image depicting a second environment.
-
-
-
-
-
-
-
-
-