公开(公告)号：US20230214027A1

公开(公告)日：2023-07-06

申请号：US17565765

申请日：2021-12-30

Applicant: Finch Technologies Ltd.

Inventor： Viktor Vladimirovich Erivantcev ,  Ravil Rustemovich Kurbanaev ,  Rustam Rafikovich Kulchurin

IPC: G06F3/0346 ,  G06F3/01

CPC classification number: G06F3/0346 ,  G06F3/011 ,  G06F3/016

Abstract: A system to extrapolate from motion states measured for past time instances during a user movement to predict motion states at a subsequent time instance at a display of a virtual object corresponding to the user movement. The prediction can be used to render the display and reduce or eliminate the lag between user action and corresponding action of the virtual object. An artificial neural network can be trained to improve the prediction accuracy based on patterns of user movements in the use of the application displaying virtual reality, augmented reality, mixed reality, and/or extended reality.

公开(公告)号：US11175729B2

公开(公告)日：2021-11-16

申请号：US16576672

申请日：2019-09-19

Applicant: Finch Technologies Ltd.

Inventor： Viktor Vladimirovich Erivantcev ,  Alexey Ivanovich Kartashov ,  Alexander Sergeevich Lobanov ,  Daniil Olegovich Goncharov ,  Ratmir Rasilevich Gubaidullin ,  Ravil Rustemovich Kurbanaev ,  Alexey Andreevich Gusev

IPC: G06F3/01 ,  G06T7/73 ,  G06T7/246

Abstract: A system to track orientations of parts of a user based on both images and inertial measurement units (IMUs). For example, the system receives images showing a portion of the user wearing sensor modules. The system receives a first set of orientation measurements generated by the sensor modules attached to some parts of the user. The system determines the second set of orientation measurements of one or more features of the portion of the user from the images. The system provides the first set of orientation measurements and the second set of orientation measurements as input to an artificial neural network that is configured to predict orientation measurements of the one or more other parts of the user that would be measured by additional sensor modules if the additional sensor modules were to be attached to the other parts of the user.

公开(公告)号：US11079860B2

公开(公告)日：2021-08-03

申请号：US16375108

申请日：2019-04-04

Applicant: Finch Technologies Ltd.

Inventor： Viktor Vladimirovich Erivantcev ,  Alexander Sergeevich Lobanov ,  Alexey Ivanovich Kartashov ,  Daniil Olegovich Goncharov ,  Ravil Rustemovich Kurbanaev

IPC: G06F3/0346 ,  G06F3/01 ,  G06N3/08 ,  G06N3/04

Abstract: A system having sensor modules and a computing device. Each sensor module has an inertial measurement unit configured to track its orientation. In a kinematic chain, multiple rigid parts of a user are connected via joints. At least one rigid part is not independently tracked using sensor modules. The computing device computes the estimates of the orientation of the rigid part, separately using an artificial neural network model or using assumed orientation relations. During a sequence of actions performed by the user, orientation estimates produced by one technique can be more accurate than another technique at some time instances, but less accurate at other time instances. An artificial neural network is trained to classify the accuracy the estimates and/or to combine the estimates to provide improved orientation estimates for the duration of the sequence of actions.

公开(公告)号：US20210089116A1

公开(公告)日：2021-03-25

申请号：US16576672

申请日：2019-09-19

Applicant: Finch Technologies Ltd.

Inventor： Viktor Vladimirovich Erivantcev ,  Alexey Ivanovich Kartashov ,  Alexander Sergeevich Lobanov ,  Daniil Olegovich Goncharov ,  Ratmir Rasilevich Gubaidullin ,  Ravil Rustemovich Kurbanaev ,  Alexey Andreevich Gusev

IPC: G06F3/01 ,  G06T7/73 ,  G06T7/246

Abstract: A system to track orientations of parts of a user based on both images and inertial measurement units (IMUs). For example, the system receives images showing a portion of the user wearing sensor modules. The system receives a first set of orientation measurements generated by the sensor modules attached to some parts of the user. The system determines the second set of orientation measurements of one or more features of the portion of the user from the images. The system provides the first set of orientation measurements and the second set of orientation measurements as input to an artificial neural network that is configured to predict orientation measurements of the one or more other parts of the user that would be measured by additional sensor modules if the additional sensor modules were to be attached to the other parts of the user.

公开(公告)号：US20200319721A1

公开(公告)日：2020-10-08

申请号：US16375108

申请日：2019-04-04

Applicant: Finch Technologies Ltd.

Inventor： Viktor Vladimirovich Erivantcev ,  Alexander Sergeevich Lobanov ,  Alexey Ivanovich Kartashov ,  Daniil Olegovich Goncharov ,  Ravil Rustemovich Kurbanaev

IPC: G06F3/0346 ,  G06F3/01 ,  G06N3/04 ,  G06N3/08

Abstract: A system having sensor modules and a computing device. Each sensor module has an inertial measurement unit configured to track its orientation. In a kinematic chain, multiple rigid parts of a user are connected via joints. At least one rigid part is not independently tracked using sensor modules. The computing device computes the estimates of the orientation of the rigid part, separately using an artificial neural network model or using assumed orientation relations. During a sequence of actions performed by the user, orientation estimates produced by one technique can be more accurate than another technique at some time instances, but less accurate at other time instances. An artificial neural network is trained to classify the accuracy the estimates and/or to combine the estimates to provide improved orientation estimates for the duration of the sequence of actions.