公开(公告)号：US09202280B2

公开(公告)日：2015-12-01

申请号：US14571402

申请日：2014-12-16

Applicant: Google Inc.

Inventor： Bo Wu ,  Thad Eugene Starner ,  Hayes Solos Raffle ,  Yong Zhao ,  Edward Allen Keyes

IPC: G06T7/00 ,  G06K9/00 ,  G09G3/00 ,  G09G5/00 ,  G01S17/06 ,  A61B3/00 ,  G02B27/01 ,  G03B29/00 ,  H04N5/225 ,  A61B3/113

CPC classification number: G06T7/0044 ,  A61B3/00 ,  A61B3/113 ,  G01S17/06 ,  G02B27/01 ,  G02B27/017 ,  G02B2027/0138 ,  G02B2027/014 ,  G02B2027/0178 ,  G02B2027/0187 ,  G03B29/00 ,  G03B2213/025 ,  G06F3/013 ,  G06K9/00604 ,  G06K9/0061 ,  G06T7/74 ,  G06T2207/10016 ,  G06T2207/10152 ,  G06T2207/30201 ,  G09G3/003 ,  G09G5/00 ,  G09G2354/00 ,  H04N5/225

Abstract: Methods and systems are described for determining eye position and/or for determining eye movement based on glints. An exemplary computer-implemented method involves: (a) causing a camera that is attached to a head-mounted display (HMD) to record a video of the eye; (b) while the video of the eye is being recorded, causing a plurality of light sources that are attached to the HMD and generally directed towards the eye to switch on and off according to a predetermined pattern, wherein the predetermined pattern is such that at least two of the light sources are switched on at any given time while the video of the eye is being recorded; (c) analyzing the video of the eye to detect controlled glints that correspond to the plurality of light sources; and (d) determining a measure of eye position based on the controlled glints.

Abstract translation: 描述了用于确定眼睛位置和/或基于闪光来确定眼睛运动的方法和系统。 示例性的计算机实现的方法包括：（a）使附接到头戴式显示器（HMD）的照相机记录眼睛的视频; （b）在记录眼睛的视频的同时，使根据预定图案使附接到HMD并且大体上指向眼睛的多个光源接通和断开，其中预定模式使得在 在记录眼睛的视频的任何给定时间，至少两个光源被接通; （c）分析眼睛的视频以检测对应于多个光源的受控闪光; 和（d）基于受控的闪光来确定眼睛位置的度量。

公开(公告)号：US20150160461A1

公开(公告)日：2015-06-11

申请号：US14627790

申请日：2015-02-20

Applicant: Google Inc.

Inventor： Thad Eugene Starner ,  Hayes Solos Raffle ,  Yong Zhao

IPC: G02B27/01 ,  G06F3/01 ,  G06F17/30 ,  G02B27/00

CPC classification number: G06F3/013 ,  G02B27/0093 ,  G02B27/017 ,  G02B2027/0138 ,  G02B2027/014 ,  G02B2027/0178 ,  G02B2027/0187 ,  G06F1/163

Abstract: Example methods and devices are disclosed for generating life-logs with point-of-view images. An example method may involve: receiving image-related data based on electromagnetic radiation reflected from a human eye, generating an eye reflection image based on the image-related data, generating a point-of-view image by filtering the eye reflection image, and storing the point-of-view image. The electromagnetic radiation reflected from a human eye can be captured using one or more video or still cameras associated with a suitably-configured computing device, such as a wearable computing device.

Abstract translation: 公开了用于通过点视图图像生成生命日志的示例方法和设备。 示例性方法可以包括：基于从人眼反射的电磁辐射接收图像相关数据，基于图像相关数据生成眼睛反射图像，通过滤波眼睛反射图像生成观察点图像，以及 存储视点图像。 可以使用与适当配置的计算设备（例如可穿戴式计算设备）相关联的一个或多个视频或静态摄像机来捕获从人眼反射的电磁辐射。

公开(公告)号：US08686924B2

公开(公告)日：2014-04-01

申请号：US13769784

申请日：2013-02-18

Applicant: Google Inc.

Inventor： Max Braun ,  Ryan Geiss ,  Harvey Ho ,  Thad Eugene Starner ,  Gabriel Taubman

IPC: G09G5/00

CPC classification number: G09G5/00 ,  G02B27/017 ,  G02B2027/014 ,  G02B2027/0178 ,  G02C11/10 ,  G06F1/3231 ,  G06F1/325 ,  G06F3/03547 ,  H04M1/05 ,  H04M1/6066 ,  H04M2250/12 ,  Y02D10/173 ,  Y02D50/20

Abstract: Systems and methods for selecting an action associated with a power state transition of a head-mounted display (HMD) in the form of eyeglasses are disclosed. A signal may be received from a sensor on a nose bridge of the eyeglasses indicating if the HMD is in use. Based on the received signal, a first power state for the HMD may be determined. Responsive to the determined first power state, an action associated with a power state transition of the HMD from an existing power state to the first power state may be selected. The action may be selected from among a plurality of actions associated with a plurality of state transitions. Also, the action may be a sequence of functions performed by the HMD including modifying an operating state of a primary processing component of the HMD and a detector of the HMD configured to image an environment.

Abstract translation: 公开了用于选择与眼镜形式的头戴式显示器（HMD）的功率状态转换相关联的动作的系统和方法。 可以从眼镜的鼻梁上的传感器接收信号，指示HMD是否在使用。 基于接收到的信号，可以确定HMD的第一功率状态。 响应于所确定的第一功率状态，可以选择与HMD从现有功率状态到第一功率状态的功率状态转换相关联的动作。 可以从与多个状态转换相关联的多个动作中选择动作。 此外，动作可以是由HMD执行的功能序列，包括修改HMD的主处理组件的操作状态和被配置为对环境成像的HMD的检测器。

公开(公告)号：US10665205B2

公开(公告)日：2020-05-26

申请号：US14612743

申请日：2015-02-03

Applicant: Google Inc.

Inventor： Joshua Weaver ,  Thad Eugene Starner

IPC: G09G5/12 ,  G02B27/01 ,  G06F3/01 ,  G09G5/00 ,  G06F3/147

Abstract: Example methods and systems for determining correlated movements associated with movements caused by driving a vehicle are provided. In an example, a computer-implemented method includes identifying a threshold number of sets of correlated movements. The method further includes determining that the threshold number of sets of correlated movements is associated with movements caused by driving a vehicle. The method still further includes causing the wearable computing system to select a driving user interface for the wearable computing system.

公开(公告)号：US10437882B2

公开(公告)日：2019-10-08

申请号：US14706839

申请日：2015-05-07

Applicant: Google Inc.

Inventor： Thad Eugene Starner ,  Irfan Essa ,  Hayes Solos Raffle ,  Daniel Aminzade

IPC: G06F16/783 ,  G06F3/0484 ,  G06F3/01 ,  G06F1/16 ,  G06F16/738 ,  G02B27/01 ,  G06F3/0488 ,  G06T19/00 ,  G06F3/03 ,  G06F3/00

Abstract: Methods and devices for initiating a search of an object are disclosed. In one embodiment, a method is disclosed that includes receiving video data recorded by a camera on a wearable computing device, where the video data comprises at least a first frame and a second frame. The method further includes, based on the video data, detecting an area in the first frame that is at least partially bounded by a pointing device and, based on the video data, detecting in the second frame that the area is at least partially occluded by the pointing device. The method still further includes initiating a search on the area.

公开(公告)号：US10083289B1

公开(公告)日：2018-09-25

申请号：US15202477

申请日：2016-07-05

Applicant: Google Inc.

Inventor： Thad Eugene Starner ,  Karissa A. Sawyer

IPC: G06F7/04 ,  G06F21/36

CPC classification number: G06F21/36

Abstract: This document describes authentication using an interactive cord. An interactive cord includes a cable, and a fabric cover that covers the cable. The fabric cover includes one or more conductive threads woven into the fabric cover to form one or more capacitive touchpoints which are configured to enable reception of touch input that causes a change in capacitance to the one or more conductive threads. The interactive cord can be used to authenticate a user. For example, rather than using a password entered into a computing device, a touch input pattern can be provided to interactive cord that is coupled to the computing device to authenticate the user.

公开(公告)号：US09811535B1

公开(公告)日：2017-11-07

申请号：US14066651

申请日：2013-10-29

Applicant: Google Inc.

Inventor： Michael Patrick Johnson ,  Thad Eugene Starner ,  Christopher Richard Wren

IPC: G06F17/30 ,  G06K9/00

CPC classification number: G06F17/30705 ,  G06F17/30598 ,  G06K9/00221 ,  G06K9/00335 ,  G06Q50/01

Abstract: Implementations generally relate to creating groups in a social network system. In one implementation, a method includes identifying at least one person that is proximate to a target user in a social network system, determining that the target user is generating a pattern; recognizing the at least one person proximate to the target user who is generating the pattern; creating a group in the social network system, and the group includes the at least one person generating the pattern; and associating the group with the target user.

公开(公告)号：US09727174B2

公开(公告)日：2017-08-08

申请号：US14735398

申请日：2015-06-10

Applicant: Google Inc.

Inventor： Thad Eugene Starner ,  Liang-Yu (Tom) Chi ,  Luis Ricardo Prada Gomez

IPC: G06F3/042 ,  G02B27/01 ,  G06F3/01 ,  H04N9/31 ,  G06F3/0488 ,  G03B17/54 ,  G03B21/20 ,  G03B29/00

CPC classification number: G06F3/0426 ,  G02B27/017 ,  G02B27/0172 ,  G02B2027/014 ,  G02B2027/0178 ,  G02B2027/0187 ,  G03B17/54 ,  G03B21/2033 ,  G03B29/00 ,  G06F3/01 ,  G06F3/011 ,  G06F3/017 ,  G06F3/04886 ,  H04N9/3173 ,  H04N9/3185 ,  H04N9/3194

Abstract: The present application discloses systems and methods for a virtual input device. In one example, the virtual input device includes a projector and a camera. The projector projects a pattern onto a surface. The camera captures images that can be interpreted by a processor to determine actions. The projector may be mounted on an arm of a pair of eyeglasses and the camera may be mounted on an opposite arm of the eyeglasses. A pattern for a virtual input device can be projected onto a “display hand” of a user, and the camera may be able to detect when the user uses an opposite hand to select items of the virtual input device. In another example, the camera may detect when the display hand is moving and interpret display hand movements as inputs to the virtual input device, and/or realign the projection onto the moving display hand.

公开(公告)号：US09557152B2

公开(公告)日：2017-01-31

申请号：US15044053

申请日：2016-02-15

Applicant: Google Inc.

Inventor： Thad Eugene Starner ,  Michael Patrick Johnson

IPC: G09G5/00 ,  G01B7/00 ,  G02B27/01 ,  G06F3/01 ,  G01C17/02 ,  G01C19/00 ,  G01P15/00

CPC classification number: G01B7/00 ,  G01C17/02 ,  G01C19/00 ,  G01P15/00 ,  G02B27/0093 ,  G02B27/017 ,  G02B27/0179 ,  G02B2027/0178 ,  G02B2027/0187 ,  G06F3/011 ,  G06F3/017 ,  G06F3/0346 ,  G06F3/03547

Abstract: Methods and systems are described that involve a wearable computing device or an associated device determining the orientation of a person's head relative to their body. To do so, example methods and systems may compare sensor data from the wearable computing device to corresponding sensor data from a tracking device that is expected to move in a manner that follows the wearer's body, such a mobile phone that is located in the wearable computing device's wearer's pocket.

Abstract translation: 描述了涉及可穿戴计算设备或确定人的头部相对于身体的方位的相关设备的方法和系统。 为了这样做，示例性方法和系统可以将来自可穿戴计算设备的传感器数据与来自跟踪设备的相应传感器数据进行比较，所述跟踪设备预期以跟随佩戴者的身体的方式移动，例如位于穿戴式计算机中的移动电话 设备的佩戴者的口袋。

公开(公告)号：US20160110883A1

公开(公告)日：2016-04-21

申请号：US14982330

申请日：2015-12-29

Applicant: Google Inc.

Inventor： Thad Eugene Starner

IPC: G06T7/20 ,  G06K9/46 ,  G06T7/00 ,  G06K9/00

CPC classification number: G06T7/246 ,  G01S17/08 ,  G01S17/46 ,  G02B27/017 ,  G02B2027/0138 ,  G02B2027/014 ,  G02B2027/0178 ,  G02B2027/0187 ,  G06K9/00268 ,  G06K9/00335 ,  G06K9/00617 ,  G06K9/4642 ,  G06K9/4661 ,  G06T7/50 ,  G06T7/73 ,  G06T2207/10004 ,  G06T2207/10016 ,  G06T2207/10028 ,  G06T2207/30041 ,  G06T2207/30196

Abstract: Exemplary embodiments may involve analyzing reflections from an eye to help determine where the respective sources of the reflections are located. An exemplary method involves: (a) analyzing eye-image data to determine observed movement of a reflected feature on an eye surface; (b) determining an expected movement of the reflected feature on the eye surface given a value of a z-distance parameter; (c) determining a difference between the observed movement of the reflected feature on the eye surface and the expected movement of the reflected feature on the eye surface; (d) if the difference is less than a threshold, then associating the value of the z-distance parameter with a source of the reflected feature; and (e) if the difference is greater than the threshold, then: (i) making a predetermined adjustment to the value of the z-distance parameter; and (ii) repeating (a) to (d) with the adjusted value of the z-distance parameter.

Abstract translation: 示例性实施例可以包括分析来自眼睛的反射，以帮助确定各个反射源位于何处。 一种示例性方法包括：（a）分析眼图数据以确定眼睛表面上的反射特征的观察到的移动; （b）给定z距离参数的值来确定所述眼睛表面上的反射特征的预期移动; （c）确定所观察到的眼表面上的反射特征的运动与眼表面上的反射特征的预期运动之间的差; （d）如果差值小于阈值，则将z距离参数的值与反射特征的源相关联; 和（e）如果差值大于阈值，则：（i）对z-距离参数的值进行预定的调整; 和（ii）用z距离参数的调整值重复（a）至（d）。