Gaze tracking using mapping of pupil center position

    公开(公告)号:US11249547B2

    公开(公告)日:2022-02-15

    申请号:US16670483

    申请日:2019-10-31

    Applicant: Tobii AB

    Abstract: Images of an eye are captured by a camera. For each of the images, gaze data is obtained and a position of a pupil center is estimated in the image. The gaze data indicates a gaze point and/or gaze direction of the eye when the image was captured. A mapping is calibrated using the obtained gaze data and the estimated positions of the pupil center. The mapping maps positions of the pupil center in images captured by the camera to gaze points at a surface, or to gaze directions. A further image of the eye is captured by the camera. A position of the pupil center is estimated in the further image. Gaze tracking is performed using the calibrated mapping and the estimated position of the pupil center in the further image. These steps may for example be performed at a HMD.

    Eye tracking using eyeball center position

    公开(公告)号:US11129530B2

    公开(公告)日:2021-09-28

    申请号:US16124918

    申请日:2018-09-07

    Applicant: Tobii AB

    Abstract: An eye tracking system having circuitry configured to perform a method is disclosed. An estimated radius (r) from an eyeball center to a pupil center in an eye is obtained, and an estimated eyeball center position (e) in the eye in relation to an image sensor for capturing images of the eye is determined, and an image of the eye captured by means of the image sensor, and a position of a representation of the pupil center in the eye in the obtained image is identified. An estimated pupil center position (p′) is then determined based on the estimated eyeball center position (e), the estimated radius (r), and the identified position of the representation of the pupil center in the obtained image.

    Pupil radius compensation
    4.
    发明授权

    公开(公告)号:US10820796B2

    公开(公告)日:2020-11-03

    申请号:US16124776

    申请日:2018-09-07

    Applicant: Tobii AB

    Abstract: A method is disclosed, comprising obtaining a first angular offset between a first eye direction and a first gaze direction of an eye having a first pupil size, obtaining a second angular offset between a second eye direction and a second gaze direction of the eye having a second pupil size, and forming, based on the first angular offset and the second angular offset, a compensation model describing an estimated angular offset as a function of pupil size. A system and a device comprising a circuitry configured to perform such a method are also disclosed.

    Gaze tracking using mapping of pupil center position

    公开(公告)号:US11681366B2

    公开(公告)日:2023-06-20

    申请号:US17574979

    申请日:2022-01-13

    Applicant: Tobii AB

    CPC classification number: G06F3/013 G06V40/19 G06V40/193

    Abstract: Images of an eye are captured by a camera. For each of the images, gaze data is obtained and a position of a pupil center is estimated in the image. The gaze data indicates a gaze point and/or gaze direction of the eye when the image was captured. A mapping is calibrated using the obtained gaze data and the estimated positions of the pupil center. The mapping maps positions of the pupil center in images captured by the camera to gaze points at a surface, or to gaze directions. A further image of the eye is captured by the camera. A position of the pupil center is estimated in the further image. Gaze tracking is performed using the calibrated mapping and the estimated position of the pupil center in the further image. These steps may for example be performed at a HMD.

    Eye Tracking System
    7.
    发明申请

    公开(公告)号:US20220083799A1

    公开(公告)日:2022-03-17

    申请号:US17459442

    申请日:2021-08-27

    Applicant: Tobii AB

    Abstract: An eye tracking system is provided that detects the presence of problematic blobs in an image captured by the system and removes these problematic blobs by switching off illuminators. Problematic blobs may be those obscuring the pupil of the eye of the user. Each blob is detected in a first image by the use of at least one first criterion, and then an illuminator is switched off. After the illuminator is switched off, at least one second criterion is used to identify blobs in a subsequent image. This process may be repeated until the illuminator causing the problematic blob is identified.

    Updating a cornea model
    8.
    发明授权

    公开(公告)号:US11061473B2

    公开(公告)日:2021-07-13

    申请号:US16834485

    申请日:2020-03-30

    Applicant: Tobii AB

    Abstract: A method of updating a cornea model for a cornea of an eye is disclosed, as well as a corresponding system and storage medium. The method comprises controlling a display to display a stimulus at a first depth, wherein the display is capable of displaying objects at different depths, receiving first sensor data obtained by an eye tracking sensor while the stimulus is displayed at the first depth by the display, controlling the display to display a stimulus at a second depth, wherein the second depth is different than the first depth, receiving second sensor data obtained by the eye tracking sensor while the stimulus is displayed at the second depth by the display, and updating the cornea model based on the first sensor data and the second sensor data.

    DETERMINING EYE OPENNESS WITH AN EYE TRACKING DEVICE

    公开(公告)号:US20200026068A1

    公开(公告)日:2020-01-23

    申请号:US16449828

    申请日:2019-06-24

    Applicant: Tobii AB

    Abstract: A method for determining eye openness with an eye tracking device is disclosed. The method may include determining, for pixels of an image sensor of an eye tracking device, during a first time period when an eye of a user is open, a first sum of intensity of the pixels. The method may also include determining, during a second time period when the eye of the user is closed, a second sum of intensity of the pixels. The method may further include determining, during a third time period, a third sum of intensity of the pixels. The method may additionally include determining that upon the third sum exceeding a fourth sum of the first sum plus a threshold amount, that the eye of the user is closed, the threshold amount is equal to a product of a threshold fraction and a difference between the first sum and the second sum.

    Determination of position of a head-mounted device on a user

    公开(公告)号:US11551376B2

    公开(公告)日:2023-01-10

    申请号:US16663672

    申请日:2019-10-25

    Applicant: Tobii AB

    Abstract: There is provided a method and system for determining if a head-mounted device for extended reality (XR) is correctly positioned on a user, and optionally performing a position correction procedure if the head-mounted device is determined to be incorrectly positioned on the user. Embodiments include: performing eye tracking by estimating, based on a first image of a first eye of the user, a position of a pupil in two dimensions; determining whether the estimated position of the pupil of the first eye is within a predetermined allowable area in the first image; and, if the determined position of the pupil of the first eye is inside the predetermined allowable area, concluding that the head-mounted device is correctly positioned on the user; or, if the determined position of the pupil of the first eye is outside the predetermined allowable area, concluding that the head-mounted device is incorrectly positioned on the user.

Patent Agency Ranking