-
公开(公告)号:US11249547B2
公开(公告)日:2022-02-15
申请号:US16670483
申请日:2019-10-31
Applicant: Tobii AB
Inventor: Tiesheng Wang , Gilfredo Remon Salazar , Yimu Wang , Pravin Kumar Rana , Johannes Kron , Mark Ryan , Torbjörn Sundberg
Abstract: Images of an eye are captured by a camera. For each of the images, gaze data is obtained and a position of a pupil center is estimated in the image. The gaze data indicates a gaze point and/or gaze direction of the eye when the image was captured. A mapping is calibrated using the obtained gaze data and the estimated positions of the pupil center. The mapping maps positions of the pupil center in images captured by the camera to gaze points at a surface, or to gaze directions. A further image of the eye is captured by the camera. A position of the pupil center is estimated in the further image. Gaze tracking is performed using the calibrated mapping and the estimated position of the pupil center in the further image. These steps may for example be performed at a HMD.
-
公开(公告)号:US11129530B2
公开(公告)日:2021-09-28
申请号:US16124918
申请日:2018-09-07
Applicant: Tobii AB
Inventor: Simon Johansson , Mark Ryan
Abstract: An eye tracking system having circuitry configured to perform a method is disclosed. An estimated radius (r) from an eyeball center to a pupil center in an eye is obtained, and an estimated eyeball center position (e) in the eye in relation to an image sensor for capturing images of the eye is determined, and an image of the eye captured by means of the image sensor, and a position of a representation of the pupil center in the eye in the obtained image is identified. An estimated pupil center position (p′) is then determined based on the estimated eyeball center position (e), the estimated radius (r), and the identified position of the representation of the pupil center in the obtained image.
-
公开(公告)号:US20210256715A1
公开(公告)日:2021-08-19
申请号:US17039869
申请日:2020-09-30
Applicant: Tobii AB
Inventor: Mark Ryan , Oscar Lundqvist , Oscar Nyman
Abstract: A computer-implemented method of selecting a sequence of images of a user's eye for an eye tracking application wherein each image is captured when a stationary stimulus point is displayed to the user, the method comprising: for a plurality of different pairs of the images: comparing the pair of images with each other to determine an image-score that represents a degree of difference between the compared images; and calculating a sequence-score based on the image-scores for the plurality of pairs of images.
-
公开(公告)号:US10820796B2
公开(公告)日:2020-11-03
申请号:US16124776
申请日:2018-09-07
Applicant: Tobii AB
Inventor: Mark Ryan , Simon Johansson , Erik Lindén
Abstract: A method is disclosed, comprising obtaining a first angular offset between a first eye direction and a first gaze direction of an eye having a first pupil size, obtaining a second angular offset between a second eye direction and a second gaze direction of the eye having a second pupil size, and forming, based on the first angular offset and the second angular offset, a compensation model describing an estimated angular offset as a function of pupil size. A system and a device comprising a circuitry configured to perform such a method are also disclosed.
-
公开(公告)号:US11681366B2
公开(公告)日:2023-06-20
申请号:US17574979
申请日:2022-01-13
Applicant: Tobii AB
Inventor: Tiesheng Wang , Gilfredo Remon Salazar , Yimu Wang , Pravin Kumar Rana , Johannes Kron , Mark Ryan , Torbjörn Sundberg
CPC classification number: G06F3/013 , G06V40/19 , G06V40/193
Abstract: Images of an eye are captured by a camera. For each of the images, gaze data is obtained and a position of a pupil center is estimated in the image. The gaze data indicates a gaze point and/or gaze direction of the eye when the image was captured. A mapping is calibrated using the obtained gaze data and the estimated positions of the pupil center. The mapping maps positions of the pupil center in images captured by the camera to gaze points at a surface, or to gaze directions. A further image of the eye is captured by the camera. A position of the pupil center is estimated in the further image. Gaze tracking is performed using the calibrated mapping and the estimated position of the pupil center in the further image. These steps may for example be performed at a HMD.
-
公开(公告)号:US11443440B2
公开(公告)日:2022-09-13
申请号:US17039869
申请日:2020-09-30
Applicant: Tobii AB
Inventor: Mark Ryan , Oscar Lundqvist , Oscar Nyman
Abstract: A computer-implemented method of selecting a sequence of images of a user's eye for an eye tracking application wherein each image is captured when a stationary stimulus point is displayed to the user, the method comprising: for a plurality of different pairs of the images: comparing the pair of images with each other to determine an image-score that represents a degree of difference between the compared images; and calculating a sequence-score based on the image-scores for the plurality of pairs of images.
-
公开(公告)号:US20220083799A1
公开(公告)日:2022-03-17
申请号:US17459442
申请日:2021-08-27
Applicant: Tobii AB
Inventor: Viktor Wase , Erik Ljungzell , Mark Ryan , Chiara Giordano , Rickard Lundahl , Pravin Kumar Rana
Abstract: An eye tracking system is provided that detects the presence of problematic blobs in an image captured by the system and removes these problematic blobs by switching off illuminators. Problematic blobs may be those obscuring the pupil of the eye of the user. Each blob is detected in a first image by the use of at least one first criterion, and then an illuminator is switched off. After the illuminator is switched off, at least one second criterion is used to identify blobs in a subsequent image. This process may be repeated until the illuminator causing the problematic blob is identified.
-
公开(公告)号:US11061473B2
公开(公告)日:2021-07-13
申请号:US16834485
申请日:2020-03-30
Applicant: Tobii AB
Inventor: Mark Ryan , Jonas Sjöstrand , Erik Lindén , Pravin Rana
Abstract: A method of updating a cornea model for a cornea of an eye is disclosed, as well as a corresponding system and storage medium. The method comprises controlling a display to display a stimulus at a first depth, wherein the display is capable of displaying objects at different depths, receiving first sensor data obtained by an eye tracking sensor while the stimulus is displayed at the first depth by the display, controlling the display to display a stimulus at a second depth, wherein the second depth is different than the first depth, receiving second sensor data obtained by the eye tracking sensor while the stimulus is displayed at the second depth by the display, and updating the cornea model based on the first sensor data and the second sensor data.
-
公开(公告)号:US20200026068A1
公开(公告)日:2020-01-23
申请号:US16449828
申请日:2019-06-24
Applicant: Tobii AB
Inventor: Mark Ryan , Torbjörn Sundberg , Pravin Rana , Yimu Wang
IPC: G02B26/08 , A61B5/16 , A61B3/11 , A61B3/113 , A61B5/107 , A61B5/11 , A61B5/00 , G06F3/01 , G06K9/00 , G02B27/00 , G06T7/73 , G06T7/70
Abstract: A method for determining eye openness with an eye tracking device is disclosed. The method may include determining, for pixels of an image sensor of an eye tracking device, during a first time period when an eye of a user is open, a first sum of intensity of the pixels. The method may also include determining, during a second time period when the eye of the user is closed, a second sum of intensity of the pixels. The method may further include determining, during a third time period, a third sum of intensity of the pixels. The method may additionally include determining that upon the third sum exceeding a fourth sum of the first sum plus a threshold amount, that the eye of the user is closed, the threshold amount is equal to a product of a threshold fraction and a difference between the first sum and the second sum.
-
公开(公告)号:US11551376B2
公开(公告)日:2023-01-10
申请号:US16663672
申请日:2019-10-25
Applicant: Tobii AB
Inventor: Joakim Zachrisson , Mikael Rosell , Carlos Pedreira , Mark Ryan , Simon Johansson
Abstract: There is provided a method and system for determining if a head-mounted device for extended reality (XR) is correctly positioned on a user, and optionally performing a position correction procedure if the head-mounted device is determined to be incorrectly positioned on the user. Embodiments include: performing eye tracking by estimating, based on a first image of a first eye of the user, a position of a pupil in two dimensions; determining whether the estimated position of the pupil of the first eye is within a predetermined allowable area in the first image; and, if the determined position of the pupil of the first eye is inside the predetermined allowable area, concluding that the head-mounted device is correctly positioned on the user; or, if the determined position of the pupil of the first eye is outside the predetermined allowable area, concluding that the head-mounted device is incorrectly positioned on the user.
-
-
-
-
-
-
-
-
-