-
公开(公告)号:US10579141B2
公开(公告)日:2020-03-03
申请号:US16036536
申请日:2018-07-16
Applicant: North Inc.
Inventor: Idris S. Aleem , Mayank Bhargava , Dylan Jacobs
Abstract: Systems, methods and articles that provide dynamic calibration of eye tracking systems for wearable heads-up displays (WHUDs). The eye tracking system may determine a user's gaze location on a display of the WHUD utilizing a calibration point model that includes a plurality of calibration points. During regular use of the WHUD by the user, the calibration point model may be dynamically updated based on the user's interaction with user interface (UI) elements presented on the display. The UI elements may be specifically designed (e.g., shaped, positioned, displaced) to provide in-use and on-going dynamic calibration of the eye tracking system, which in at least some implementations may be unnoticeable to the user.
-
公开(公告)号:US10409057B2
公开(公告)日:2019-09-10
申请号:US15827667
申请日:2017-11-30
Applicant: North Inc.
Inventor: Idris S. Aleem , Mayank Bhargava
Abstract: Systems, devices, and methods that use elements of a scanning laser projector (“SLP”) to determine the gaze direction of a user of a wearable heads-up display (“WHUD”) are described. An infrared laser diode is added to an RGB SLP and an infrared photodetector is aligned to detect reflections of the infrared light from the eye. A scan mirror in the SLP sweeps through a range of orientations and the intensities of reflections of the infrared light are monitored by a processor to determine when a spectral reflection or “glint” is produced. The processor determines the orientation of the scan mirror that produced the glint and maps the scan mirror orientation to a region in the field of view of the eye of the user, such as a region in visible display content projected by the WHUD, to determine the gaze direction of the user.
-
公开(公告)号:US20190171006A1
公开(公告)日:2019-06-06
申请号:US16258088
申请日:2019-01-25
Applicant: NORTH INC.
Inventor: Idris S. Aleem , Mélodie Vidal , Jake Chapeskie
Abstract: Systems, devices, and methods for laser eye tracking are described. Laser eye tracking involves scanning laser light over the eye and detecting diffuse reflections of the laser light with one or more photodetector(s). While conventional camera-based eye tracking techniques rely on detecting and identifying specific reflections (i.e., Purkinje images such as the “glint”), the laser eye tracking techniques described herein detect and identify a reduction in reflection intensity due to transmission of laser light through the pupil and/or increased diffusivity of reflections from the cornea relative to reflections from the sclera. This effect is referred to herein as the “corneal shadow” effect. Laser eye tracking uses considerably less power than conventional camera-based eye tracking techniques. As a result, the laser eye tracking techniques described herein do not add significant power demands to a system and can be implemented in wearable heads-up displays without adding significant volume to the system battery.
-
公开(公告)号:US10459220B2
公开(公告)日:2019-10-29
申请号:US15827675
申请日:2017-11-30
Applicant: North Inc.
Inventor: Idris S. Aleem , Mayank Bhargava
IPC: G02B27/01 , G06F3/01 , H04N9/31 , H04N13/383 , G02B27/00 , G02B5/32 , G06F3/03 , G02B26/10 , G02B26/08
Abstract: Systems, devices, and methods that use elements of a scanning laser projector (“SLP”) to determine the gaze direction of a user of a wearable heads-up display (“WHUD”) are described. An infrared laser diode is added to an RGB SLP and an infrared photodetector is aligned to detect reflections of the infrared light from the eye. A scan mirror in the SLP sweeps through a range of orientations and the intensities of reflections of the infrared light are monitored by a processor to determine when a spectral reflection or “glint” is produced. The processor determines the orientation of the scan mirror that produced the glint and maps the scan mirror orientation to a region in the field of view of the eye of the user, such as a region in visible display content projected by the WHUD, to determine the gaze direction of the user.
-
公开(公告)号:US20190324532A1
公开(公告)日:2019-10-24
申请号:US16376604
申请日:2019-04-05
Applicant: North Inc.
Inventor: Idris S. Aleem , Andrew S. Logan , Mayank Bhargava
Abstract: A method of tracking an eye of a user on a wearable heads-up display (WHUD) worn on the head of the user includes generating infrared light over an eye tracking period, scanning the infrared light over the eye, and detecting reflections of the infrared light from the eye. A motion parameter that is sensitive to motion of the WHUD is measured. Eye tracking is performed in a first mode that is based on glint for values of the motion parameter that fall within a first range of motion parameter values for which an error in measurement of glint position. Eye tracking is performed in a second mode that is based on glint-pupil vector for values of the motion parameter that fall within a second range of motion parameter values for which an error in measurement of glint position exceeds the error threshold. A head-mounted apparatus with eye tracking is disclosed.
-
6.
公开(公告)号:US20190317598A1
公开(公告)日:2019-10-17
申请号:US16376674
申请日:2019-04-05
Applicant: North Inc.
Inventor: Idris S. Aleem , Andrew S. Logan , Mayank Bhargava
IPC: G06F3/01 , G02B27/01 , H04N13/383
Abstract: A method of tracking an eye of a user includes generating infrared light over an eye tracking period, scanning the infrared light over the eye, and detecting reflections of the infrared light from the eye. Shifts in a position of a wearable heads-up display (WHUD) worn on the head of the user are detected during at least a portion of the eye tracking period. Glints are identified from the detected reflections of the infrared light. A drift in a glint center position of an identified glint relative to a glint space is determined based on a detected shift in position of the WHUD corresponding in space to the identified glint. The glint center position is adjusted to compensate for the drift. The adjusted glint center position is transformed from the glint space to a gaze position in a display space in a field of view of the eye.
-
7.
公开(公告)号:US20190317597A1
公开(公告)日:2019-10-17
申请号:US16376319
申请日:2019-04-05
Applicant: North Inc.
Inventor: Idris S. Aleem , Andrew S. Logan , Mayank Bhargava
Abstract: A method of tracking an eye of a user includes generating an infrared light, scanning the infrared light over the eye, and detecting reflections of the infrared light from the eye over an eye tracking period. A plurality of glints is identified from the reflections of the infrared light detected. A glint center position of each glint in a glint space is determined and transformed to a gaze position in a display space. At least once during the eye tracking period, an image of the eye is reconstructed from a portion of the reflections of the infrared light detected. A pupil is detected from the image, and a pupil center position is determined. A glint-pupil vector is determined from the pupil center position and the glint center position of at least one glint corresponding in space to the pupil. The glint space is recalibrated based on the glint-pupil vector.
-
公开(公告)号:US20190258062A1
公开(公告)日:2019-08-22
申请号:US16269385
申请日:2019-02-06
Applicant: North Inc.
Inventor: Idris S. Aleem , Andrew S. Logan
Abstract: An eye tracking system for tracking an eye of a user includes at least one infrared laser diode to output an infrared light and an optical scanner positioned to receive the infrared light outputted by the at least one infrared laser diode and controllable to scan the infrared light over a target area. A holographic optical element is positioned at the target area to receive the infrared light from the optical scanner and redirect the infrared light to the eye of the user. An infrared detector is aligned to detect at least a portion of the infrared light returned from the eye of the user. An infrared filter is disposed in a position to selectively block transmission of infrared wavelengths through the holographic optical element from a side of the holographic optical element. An eyeglass lens, a wearable heads-up display, and a method of eye tracking are also described.
-
公开(公告)号:US20220142473A1
公开(公告)日:2022-05-12
申请号:US17434127
申请日:2020-07-27
Applicant: NORTH INC.
Inventor: Ahmed Gawish , Idris S. Aleem
Abstract: Systems and methods of detecting pupillary positions on a head of a subject are described. While a camera and a light source are positioned in front of the head of the subject, the camera is caused to capture image data representative of a frontal portion of the head of the subject. From the image data, a face of the subject is detected. Up to two eyes are identified from the detected face. A reflection of the light source on each identified eye is detected. A pupillary position of each identified eye is estimated based on a position of the detected light source reflection on the identified eye. One or more of interpupillary distance, left pupil distance, and right pupil distance may be determined from the estimated pupillary positions.
-
公开(公告)号:US11307409B2
公开(公告)日:2022-04-19
申请号:US16879047
申请日:2020-05-20
Applicant: North Inc.
Inventor: Idris S. Aleem
Abstract: A method of tracking a gaze of an eye includes tracking the gaze of the eye in a first tracking mode. Glint data of at least one glint of the eye is obtained during at least a portion of tracking the gaze of the eye in the first tracking mode. The glint data is in a time domain and includes a time series of a spatial descriptor associated with the at least one glint. The glint data is transformed into a frequency domain to generate a glint frequency spectrum. A stability of the at least one glint is determined based on the glint frequency spectrum. If the at least one glint is determined to be unstable, tracking of the gaze of the eye is switched from the first tracking mode to a second tracking mode that is different from the first tracking mode.
-
-
-
-
-
-
-
-
-