-
公开(公告)号:US20180335855A1
公开(公告)日:2018-11-22
申请号:US15787555
申请日:2017-10-18
Applicant: Finch Technologies Ltd.
Inventor: Viktor Vladimirovich Erivantcev , Rustam Rafikovich Kulchurin , Alexander Sergeevich Lobanov , Iakov Evgenevich Sergeev , Alexey Ivanovich Kartashov
IPC: G06F3/0346 , A63F13/211 , A63F13/212 , A63F13/235 , G06F3/01
CPC classification number: G06F3/014 , A63F13/211 , A63F13/212 , A63F13/235 , G06F3/011 , G06F3/017 , G06F3/0346
Abstract: A system including: a first sensor module having an inertial measurement unit and attached to an upper arm of a user, the first sensor module generating first motion data identifying an orientation of the upper arm; a second sensor module having an inertial measurement unit and attached to a hand of the user, the second sensor module generating second motion data identifying an orientation of the hand; and a computing device coupled to the first sensor module and the second sensor module through communication links, the computing device calculating, based on the orientation of the upper arm and the orientation of the hand, an orientation of a forearm connected to the hand by a wrist of the user and connected to the upper arm by an elbow joint of the user.
-
公开(公告)号:US20180335843A1
公开(公告)日:2018-11-22
申请号:US15792255
申请日:2017-10-24
Applicant: Finch Technologies Ltd.
Inventor: Viktor Vladimirovich Erivantcev , Rustam Rafikovich Kulchurin , Alexander Sergeevich Lobanov , Iakov Evgenevich Sergeev , Alexey Ivanovich Kartashov
IPC: G06F3/01 , G06F3/0346
Abstract: A system including: a first sensor module having an inertial measurement unit and attached to a palm of a hand of a user; a second sensor module having an inertial measurement unit and attached to a first bone of a finger (e.g., a middle or proximal phalange bone) on the palm; and a computing device coupled to the first sensor module and the second sensor module to calculate, based on the orientation of the palm and the orientation of the first bone, orientations of the second bones of the finger (e.g., a distal or proximal phalange bone, a metacarpal bone of the thumb) that have no separately attached inertial measurement unit, according to a predetermined ratio of rotation from a reference orientation along a same axis of rotation.
-
公开(公告)号:US11093036B2
公开(公告)日:2021-08-17
申请号:US16508249
申请日:2019-07-10
Applicant: Finch Technologies Ltd.
Inventor: Viktor Vladimirovich Erivantcev , Rustam Rafikovich Kulchurin , Alexander Sergeevich Lobanov , Iakov Evgenevich Sergeev , Alexey Ivanovich Kartashov
IPC: G06F3/01 , G06F3/0346 , A63F13/211 , A63F13/212 , A63F13/235
Abstract: A system including: a first sensor module having an inertial measurement unit and attached to an upper arm of a user, the first sensor module generating first motion data identifying an orientation of the upper arm; a second sensor module having an inertial measurement unit and attached to a hand of the user, the second sensor module generating second motion data identifying an orientation of the hand; and a computing device coupled to the first sensor module and the second sensor module through communication links, the computing device calculating, based on the orientation of the upper arm and the orientation of the hand, an orientation of a forearm connected to the hand by a wrist of the user and connected to the upper arm by an elbow joint of the user.
-
公开(公告)号:US11079860B2
公开(公告)日:2021-08-03
申请号:US16375108
申请日:2019-04-04
Applicant: Finch Technologies Ltd.
Inventor: Viktor Vladimirovich Erivantcev , Alexander Sergeevich Lobanov , Alexey Ivanovich Kartashov , Daniil Olegovich Goncharov , Ravil Rustemovich Kurbanaev
IPC: G06F3/0346 , G06F3/01 , G06N3/08 , G06N3/04
Abstract: A system having sensor modules and a computing device. Each sensor module has an inertial measurement unit configured to track its orientation. In a kinematic chain, multiple rigid parts of a user are connected via joints. At least one rigid part is not independently tracked using sensor modules. The computing device computes the estimates of the orientation of the rigid part, separately using an artificial neural network model or using assumed orientation relations. During a sequence of actions performed by the user, orientation estimates produced by one technique can be more accurate than another technique at some time instances, but less accurate at other time instances. An artificial neural network is trained to classify the accuracy the estimates and/or to combine the estimates to provide improved orientation estimates for the duration of the sequence of actions.
-
公开(公告)号:US20210208180A1
公开(公告)日:2021-07-08
申请号:US17208628
申请日:2021-03-22
Applicant: Finch Technologies Ltd.
Inventor: Viktor Vladimirovich Erivantcev , Alexander Sergeevich Lobanov , Alexey Ivanovich Kartashov , Daniil Olegovich Goncharov
Abstract: A system including: a plurality of sensor modules having inertial measurement units and attached to different parts of a user (e.g., head, hands, arms) to measure their orientations; a plurality of optical marks attached to the user; a camera attached to the user; and a computing device configured to correct an accumulated error by detecting the optical marks in an image generated by the camera and identifying mismatches in directions of the optical marks (or the sensors, or parts of the users) as measured and/or calculated based on the image and the corresponding directions of the optical marks (or the sensors, or parts of the users) as measured and/or calculated from the orientation measurements generated by the sensor modules.
-
公开(公告)号:US20210089116A1
公开(公告)日:2021-03-25
申请号:US16576672
申请日:2019-09-19
Applicant: Finch Technologies Ltd.
Inventor: Viktor Vladimirovich Erivantcev , Alexey Ivanovich Kartashov , Alexander Sergeevich Lobanov , Daniil Olegovich Goncharov , Ratmir Rasilevich Gubaidullin , Ravil Rustemovich Kurbanaev , Alexey Andreevich Gusev
Abstract: A system to track orientations of parts of a user based on both images and inertial measurement units (IMUs). For example, the system receives images showing a portion of the user wearing sensor modules. The system receives a first set of orientation measurements generated by the sensor modules attached to some parts of the user. The system determines the second set of orientation measurements of one or more features of the portion of the user from the images. The system provides the first set of orientation measurements and the second set of orientation measurements as input to an artificial neural network that is configured to predict orientation measurements of the one or more other parts of the user that would be measured by additional sensor modules if the additional sensor modules were to be attached to the other parts of the user.
-
27.
公开(公告)号:US20200319721A1
公开(公告)日:2020-10-08
申请号:US16375108
申请日:2019-04-04
Applicant: Finch Technologies Ltd.
Inventor: Viktor Vladimirovich Erivantcev , Alexander Sergeevich Lobanov , Alexey Ivanovich Kartashov , Daniil Olegovich Goncharov , Ravil Rustemovich Kurbanaev
IPC: G06F3/0346 , G06F3/01 , G06N3/04 , G06N3/08
Abstract: A system having sensor modules and a computing device. Each sensor module has an inertial measurement unit configured to track its orientation. In a kinematic chain, multiple rigid parts of a user are connected via joints. At least one rigid part is not independently tracked using sensor modules. The computing device computes the estimates of the orientation of the rigid part, separately using an artificial neural network model or using assumed orientation relations. During a sequence of actions performed by the user, orientation estimates produced by one technique can be more accurate than another technique at some time instances, but less accurate at other time instances. An artificial neural network is trained to classify the accuracy the estimates and/or to combine the estimates to provide improved orientation estimates for the duration of the sequence of actions.
-
28.
公开(公告)号:US20200225738A1
公开(公告)日:2020-07-16
申请号:US16827573
申请日:2020-03-23
Applicant: Finch Technologies Ltd.
Inventor: Viktor Vladimirovich Erivantcev , Alexander Sergeevich Lobanov , Alexey Ivanovich Kartashov , Daniil Olegovich Goncharov
IPC: G06F3/01 , G06N3/04 , G06F3/0346 , G06N3/08
Abstract: A system having sensor modules and a computing device. Each sensor module has an inertial measurement unit attached to a portion of a user to generate motion data identifying a sequence of orientations of the portion. The sensor modules include a first subset and a second subset that share a common sensor module. The computing device provides orientation measurements generated by the first subset as input to a first artificial neural network to obtain at least one first orientation measurement of the common module, provides orientation measurements generated by the second subset as input to a second artificial neural network to obtain at least one second orientation measurement of the common module, and generates, a predicted orientation measurement of the common module by combining the at least one first orientation measurement of the common module and the at least one second orientation measurement of the common module.
-
公开(公告)号:US10540006B2
公开(公告)日:2020-01-21
申请号:US15813813
申请日:2017-11-15
Applicant: Finch Technologies Ltd.
Inventor: Viktor Vladimirovich Erivantcev , Rustam Rafikovich Kulchurin , Alexander Sergeevich Lobanov , Iakov Evgenevich Sergeev , Alexey Ivanovich Kartashov
Abstract: A system including: two arm modules each having an inertial measurement unit and attached to an upper arm of a user to measure the current orientations of the upper arms of the user; a head module having an inertial measurement unit and attached to the head of the user to measure the current orientation of the head; and a computing device coupled to the arm modules and the head module to calculate, based on the current orientations of the upper arms and the current orientation of the head, the current orientation of the torso of the user.
-
公开(公告)号:US10509469B2
公开(公告)日:2019-12-17
申请号:US15492915
申请日:2017-04-20
Applicant: Finch Technologies Ltd.
Inventor: Viktor Vladimirovich Erivantcev , Rustam Rafikovich Kulchurin , Alexander Sergeevich Lobanov , Iakov Evgenevich Sergeev , Yana Olegovna Gabdullina , Alexey Ivanovich Kartashov
IPC: G06F3/01 , A63F13/24 , G06F3/038 , G06F3/0354 , G06F3/0346 , A63F13/211 , G06F3/02 , G06F3/0338 , G06F3/0362 , A63F13/235
Abstract: Disclosed herein is a data input device and method of operating the same. In one embodiment, a data input device comprises a plurality of inertial sensor units, one or more touch input devices, a microcontroller configured to collect sensor data from the inertial sensors and the one or more touch input devices and process the sensor data to generate processed sensor data, and a wireless transceiver configured to transmit the processed sensor data to a host computer. In another embodiment, a method comprises receiving sensor data from a handheld device; calculating hand movement characteristics in three dimensional space based on the sensor data; calculating the position and orientation of the components of the handheld device; identifying positions and movements of one or more fingers of a user manipulating the handheld device; identifying a gesture from the positions and movements of one or more fingers of a user manipulating the handheld device; identifying a recognized gesture corresponding to the identified gesture; and dispatching an event notifying the gesture to an application.
-
-
-
-
-
-
-
-
-