公开(公告)号：US20230281935A1

公开(公告)日：2023-09-07

申请号：US18115510

申请日：2023-02-28

Applicant: Google LLC

Inventor： Adam Mittleman ,  Jason Chamberlain ,  Jacobi Grillo ,  Daniel Biran ,  Mark Kraz ,  Lauren Chanen ,  Daniel Foran ,  David Fichou ,  William Dong ,  Bao-Tram Phan Nguyen ,  Brian Silverstein ,  Yash Modi ,  Alex Finlayson ,  Dongeek Shin

IPC: G06T19/00 ,  G06T19/20 ,  G06T15/30 ,  G06T15/20

CPC classification number: G06T19/006 ,  G06T19/20 ,  G06T15/30 ,  G06T15/20 ,  G06T2219/2021 ,  G06T2219/2012

Abstract: A method for guiding installation of smart-home devices may include capturing, by a camera of a mobile computing device, a view of an installation location for a smart-home device; rendering, by the mobile computing device, a view of a virtual object that represents a real-world obstruction that will interfere with the operation or installation of the smart-home device; and displaying, by the mobile computing device, the view of a virtual object that represents real-world obstruction with the view of the installation location on the display of the mobile computing device.

公开(公告)号：US11716569B2

公开(公告)日：2023-08-01

申请号：US17565916

申请日：2021-12-30

Applicant: Google LLC

Inventor： Dongeek Shin ,  Gabriel Slotnick

IPC: H04R29/00 ,  H04R5/04 ,  H04R5/02 ,  H04R27/00 ,  H04S7/00

CPC classification number: H04R5/04 ,  H04R5/02 ,  H04R27/00 ,  H04R29/001 ,  H04S7/301 ,  H04R2227/005 ,  H04R2227/009

Abstract: Methods, systems, and media for identifying a plurality of sets of coordinates for a plurality of devices are provided. In some embodiments, the method comprises: identifying each device in a plurality of devices associated with a user account; instructing the plurality of devices to perform an audio sequence; receiving a plurality of transit times from the plurality of devices; determining a plurality of distances based on the plurality of transit times; determining a plurality of sets of coordinates based on the plurality of distances; associating to each of the plurality of devices a corresponding unique one of the plurality of sets of coordinates; and causing at least one of the plurality of devices to play spatial audio determined from the plurality of sets of coordinates.

公开(公告)号：US20230164508A1

公开(公告)日：2023-05-25

申请号：US17456007

申请日：2021-11-22

Applicant: GOOGLE LLC

Inventor： Dongeek Shin

IPC: H04S7/00 ,  H04R1/40 ,  G06F3/01 ,  G06T7/70

CPC classification number: H04S7/303 ,  H04R1/406 ,  G06F3/013 ,  G06T7/70 ,  G06T2207/30201

Abstract: Beamforming can improve the audio quality and/or intensity in a particular direction, which can help a user hear, especially in certain environments. Augmented reality glasses can track the eye, or eyes, of a user which can trigger and guide the beamforming towards a particular object of interest, such as a person speaking. The beamforming may be made efficient by storing information necessary for beamforming in a database and recalling the information at runtime.

公开(公告)号：US11627890B2

公开(公告)日：2023-04-18

申请号：US17846438

申请日：2022-06-22

Applicant: Google LLC

Inventor： Dongeek Shin ,  Michael Dixon ,  Jake Garrison ,  Andrew William Goldenson

IPC: A61B5/08 ,  G10L25/51 ,  H04R1/04 ,  G10L15/22 ,  G10L15/30 ,  H04R1/02 ,  G01S7/41 ,  G06N20/00 ,  G06N5/04 ,  A61B7/00 ,  A61B5/05 ,  A61B5/00 ,  G06F3/16 ,  G06F3/14

Abstract: Methods, devices, and systems for contactless cough detection and attribution are presented herein. Audio data may be received using a microphone. A cough may be identified as having occurred based on the received audio data. Radar data may be received indicative of reflected radio waves from a radar sensor. A state analysis process may be performed using the received radar data. The detected cough may be attributed to a particular user based at least in part on the state analysis process performed using the radar data.

公开(公告)号：US11592908B2

公开(公告)日：2023-02-28

申请号：US17249966

申请日：2021-03-19

Applicant: GOOGLE LLC

Inventor： Dongeek Shin ,  Shahram Izadi ,  David Kim ,  Sofien Bouaziz ,  Steven Benjamin Goldberg ,  Ivan Poupyrev ,  Shwetak N. Patel

IPC: G06F3/01 ,  G06F1/16 ,  G06V40/20

Abstract: Techniques of identifying gestures include detecting and classifying inner-wrist muscle motions at a user's wrist using micron-resolution radar sensors. For example, a user of an AR system may wear a band around their wrist. When the user makes a gesture to manipulate a virtual object in the AR system as seen in a head-mounted display (HMD), muscles and ligaments in the user's wrist make small movements on the order of 1-3 mm. The band contains a small radar device that has a transmitter and a number of receivers (e.g., three) of electromagnetic (EM) radiation on a chip (e.g., a Soli chip. This radiation reflects off the wrist muscles and ligaments and is received by the receivers on the chip in the band. The received reflected signal, or signal samples, are then sent to processing circuitry for classification to identify the wrist movement as a gesture.

公开(公告)号：US20230027320A1

公开(公告)日：2023-01-26

申请号：US17872438

申请日：2022-07-25

Applicant: Google LLC

Inventor： Anupam J. Pathak ,  Jian Cui ,  Dongeek Shin

IPC: A61B5/00 ,  G06T7/00 ,  A61B5/11

Abstract: A method for facilitating a Parkinson's Disease (“PD”) assessment of a patient includes capturing first video of a patient performing first test movements while holding the mobile device; capturing second video of the patient performing second test movements while maintaining the mobile device on their person; capturing third video of the patient performing third test movements including standing and walking; capturing one or more IMU readings using an IMU of the mobile device; processing the first video, the second video, and the third video according to (i) a hand landmark model to generate one or more hand biomarkers, (ii) a face landmark model to generate one or more face biomarkers, and (iii) a body landmark model to generate one or more body biomarkers; and determining an assessment score based on a standardized PD assessment by processing the biomarkers.

公开(公告)号：US20220398304A1

公开(公告)日：2022-12-15

申请号：US17441628

申请日：2020-12-07

Applicant: Google LLC

Inventor： Dongeek Shin

IPC: G06F21/32 ,  G06V40/13 ,  G06V40/12 ,  G06F3/01 ,  G06V10/84

Abstract: Techniques and apparatuses are described that enable a device to be unlocked and continuous user authentication without a touch input dedicated to fingerprint requisition. A touch input is received that comprises one or more touches to a touchscreen, and raw image data corresponding to the touches is retrieved from a fingerprint imaging sensor. A pixel-clustering technique is performed on the raw image data to determine a portion of the raw image data that corresponds to each of the touches. Touch embeddings are formed for each of the portions of the raw image data and compared to one or more stored fingerprint embeddings that correspond to respective fingerprints of one or more authorized users. An authentication result is then determined for the touch input based on the comparison results.

公开(公告)号：US20220167481A1

公开(公告)日：2022-05-26

申请号：US17521063

申请日：2021-11-08

Applicant: Google LLC

Inventor： Dongeek Shin ,  Shwetak Patel ,  Anupam Pathak

IPC: H05B47/11 ,  H05B47/19 ,  H05B47/115 ,  G08B21/24

Abstract: Systems and techniques are provided for light source status detection. Ambient light values generated by an ambient light sensor of a device in an environment over a period of time may be received. A first light source model for the device may be generated using a first subset of the ambient light values. A second light source model for the device may be generated using a second subset of the ambient light values. A current ambient light value generated by the ambient light sensor of the device may be received. The first light source model or the second light source model may be selected based on a time at which the current ambient light value was generated. Whether the current ambient light value indicates that a local artificial light source is on may be determined using the current ambient light value and selected light source model.

公开(公告)号：US20220113394A1

公开(公告)日：2022-04-14

申请号：US17069633

申请日：2020-10-13

Applicant: Google LLC

Inventor： Dongeek Shin ,  Ivan Poupyrev

IPC: G01S13/50 ,  G06N20/00 ,  G01S13/44

Abstract: Techniques and apparatuses are described that implement a smart-device-based radar system capable of performing location tagging. The radar system has sufficient spatial resolution to recognize different external environments associated with different locations (e.g., recognize different rooms or different locations within a same room). Using the radar system, the smart device can achieve spatial awareness and automatically activate user-programmed applications or settings associated with the different locations. In this way, the radar system enables the smart device to provide a location-specific shortcut for various applications or settings. With the location-specific shortcut, the smart device can improve the user's experience and reduce the need to repeatedly navigate cumbersome interfaces.

公开(公告)号：US20250140264A1

公开(公告)日：2025-05-01

申请号：US18996721

申请日：2022-07-21

Applicant: GOOGLE LLC

Inventor： Isaac Allen Fehr ,  Angela Krone ,  Dongeek Shin ,  Ruofei Du

IPC: G10L17/26 ,  G06F3/01 ,  G10L15/22

Abstract: A system for controlling a head mounted device (HMD). The system includes a processor of a controller of the HMD connected to an Internal Measurement Unit (IMU) and a memory on which are stored machine-readable instructions that when executed by the processor, cause the processor to: receive Internal Measurement Unit (IMU) data generated in response to vibrations produced by voiced nasal consonant vocalizations produced by an HMD user, analyze the IMU data to determine whether the IMU data corresponds to an HMD control command, and responsive to a determination that the IMU data corresponds to the HMD control command, execute the HMD control command.