-
公开(公告)号:US20230393665A1
公开(公告)日:2023-12-07
申请号:US18174358
申请日:2023-02-24
Applicant: GOOGLE LLC
Inventor: Dongeek Shin , Shahram Izadi , David Kim , Sofien Bouaziz , Steven Benjamin Goldberg , Ivan Poupyrev , Shwetak N. Patel
Abstract: Techniques of identifying gestures include detecting and classifying inner-wrist muscle motions at a user's wrist using micron-resolution radar sensors. For example, a user of an AR system may wear a band around their wrist. When the user makes a gesture to manipulate a virtual object in the AR system as seen in a head-mounted display (HMD), muscles and ligaments in the user's wrist make small movements on the order of 1-3 mm. The band contains a small radar device that has a transmitter and a number of receivers (e.g., three) of electromagnetic (EM) radiation on a chip (e.g., a Soli chip. This radiation reflects off the wrist muscles and ligaments and is received by the receivers on the chip in the band. The received reflected signal, or signal samples, are then sent to processing circuitry for classification to identify the wrist movement as a gesture.
-
公开(公告)号:US11822736B1
公开(公告)日:2023-11-21
申请号:US17663978
申请日:2022-05-18
Applicant: Google LLC
Inventor: Dongeek Shin , Ricardo John Campbell
IPC: G06F3/0346 , G06F3/01
CPC classification number: G06F3/0346 , G06F3/012 , G06F3/017 , G06F2203/0331
Abstract: Physical gestures may be performed by a user to interact with a head-mounted device. These physical gestures can be detected by other devices worn by the user. For example, a fitness tracker worn on a wrist of a user may be used to detect the movement of the wrist as a gesture and then communicate this gesture to the head-mounted device. This accessory-mediated gesture interaction may be interrupted when the accessory device loses power or otherwise stops tracking. In this condition, the disclosed head-mounted device may take-over gesture detection by monitoring distortions to a magnetic field caused by movement of the device. This form of gesture detection can be used when an active device has exhausted its battery. Further, this form of gesture detection can be used for electrically inactive objects that can cause detectable changes to the magnetic field when moved in the magnetic field.
-
公开(公告)号:US20230325148A1
公开(公告)日:2023-10-12
申请号:US18331643
申请日:2023-06-08
Applicant: Google LLC
Inventor: Dongeek Shin
IPC: G06F3/16 , G10L15/22 , G06F3/038 , G06F3/01 , G06F16/683 , G06F3/0481
CPC classification number: G06F3/167 , G10L15/22 , G06F3/038 , G10L2015/228 , G06F16/685 , G06F3/0481 , G10L2015/223 , G06F3/017
Abstract: A method for a contextual assistant to use mouse pointing or touch cues includes receiving audio data corresponding to a query spoken by a user, receiving, in a graphical user interface displayed on a screen, a user input indication indicating a spatial input applied at a first location on the screen, and processing the audio data to determine a transcription of the query. The method also includes performing query interpretation on the transcription to determine that the query is referring to an object displayed on the screen without uniquely identifying the object, and requesting information about the object. The method further includes disambiguating, using the user input indication indicating the spatial input applied at the first location on the screen, the query to uniquely identify the object that the query is referring to, obtaining the information about the object requested by the query, and providing a response to the query.
-
公开(公告)号:US20230316142A1
公开(公告)日:2023-10-05
申请号:US18130731
申请日:2023-04-04
Applicant: Google LLC
Inventor: Michael Dixon , Anupam Pathak , Dongeek Shin , Arnaud Charton , Jian Cui
IPC: G06N20/00
CPC classification number: G06N20/00
Abstract: Various arrangements are presented for training and using a machine learning model. A first training data set may be created that has more samples but fewer dimensions than a second dataset. A second set of training data, created from the second dataset, has at least one additional dimension of data than the first set of training data. An additional dimension of data can then be simulated for the first set of training data. The simulated additional dimension of data can be incorporated with the first set of training data. A first machine learning model can be trained based on the first set of training data that comprises the simulated additional dimension of data to obtain various weights. A second machine learning model can then be trained based on the second set of training data and the obtained plurality of weights from the first trained machine learning model.
-
公开(公告)号:US20230306965A1
公开(公告)日:2023-09-28
申请号:US18161871
申请日:2023-01-30
Applicant: Google LLC
Inventor: Dongeek Shin
CPC classification number: G10L15/20 , G10L15/08 , G10L15/22 , G10L25/87 , G10L2015/088 , G10L2015/223
Abstract: A method for separating target speech from background noise contained in an input audio signal includes receiving the input audio signal captured by a user device, wherein the input audio signal corresponds to target speech of multiple words spoken by a target user and containing background noise in the presence of the user device while the target user spoke the multiple words in the target speech. The method also includes receiving a sequence of time markers input by the target user in cadence with the target user speaking the multiple words in the target speech, and correlating the sequence of time markers with the input audio signal to generate enhanced audio features that separate the target speech from the background noise in the input audio signal. The method also includes processing, using a speech recognition model, the enhanced audio features to generate a transcription of the target speech.
-
公开(公告)号:US11709653B1
公开(公告)日:2023-07-25
申请号:US17717292
申请日:2022-04-11
Applicant: Google LLC
Inventor: Dongeek Shin
IPC: G06F3/16 , G06F16/9032 , G06F3/0481 , G06F3/038 , G06F3/01 , G10L15/22 , G06F16/683
CPC classification number: G06F3/167 , G06F3/017 , G06F3/038 , G06F3/0481 , G06F16/685 , G10L15/22 , G10L2015/223 , G10L2015/228
Abstract: A method for a contextual assistant to use mouse pointing or touch cues includes receiving audio data corresponding to a query spoken by a user, receiving, in a graphical user interface displayed on a screen, a user input indication indicating a spatial input applied at a first location on the screen, and processing the audio data to determine a transcription of the query. The method also includes performing query interpretation on the transcription to determine that the query is referring to an object displayed on the screen without uniquely identifying the object, and requesting information about the object. The method further includes disambiguating, using the user input indication indicating the spatial input applied at the first location on the screen, the query to uniquely identify the object that the query is referring to, obtaining the information about the object requested by the query, and providing a response to the query.
-
公开(公告)号:US11688263B2
公开(公告)日:2023-06-27
申请号:US17294268
申请日:2019-01-08
Applicant: Google LLC
Inventor: Dongeek Shin , Yu Wen , Zhifeng Cai , Brian Mitchell Silverstein , Raymond Reynolds Hayes , Kevin N. Hayes
CPC classification number: G08B21/043 , G08B29/188 , H04L5/0055 , H04L67/34 , H04W4/027 , G08B13/2491 , H04L67/104
Abstract: This document describes techniques and devices to detect and classify human and animal presence and/or motion based on changes in the interaction of the human or animal with Wireless Local Area Network (WLAN) radio frequency (RF) signals within or about a building structure, such as a home or office. A first WLAN device transmits a sounding packet to a second WLAN device and receives an acknowledgement (ACK) of receiving the sounding packet by the second WLAN device. The first WLAN device uses the received ACK to determine Channel State Information (CSI) for an RF signal path between the first WLAN device and the second WLAN device, aggregates the determined CSI with additional CSI, and uses the aggregated CSI to determine a presence or a motion within the structure.
-
公开(公告)号:US11543892B2
公开(公告)日:2023-01-03
申请号:US17302258
申请日:2021-04-28
Applicant: GOOGLE LLC
Inventor: Dongeek Shin , Shahram Izadi , Shwetak N. Patel
Abstract: A computing device, such as a wearable device, may include at least two electrodes mounted on a body. The computing device may determine an electrical signal associated with a circuit that includes the at least two electrodes and the user. A pressure applied to at least one electrode of the at least two electrodes may be determined from the electrical signal, and at least one function of the computing device may be implemented, based on the pressure.
-
公开(公告)号:US20220218224A1
公开(公告)日:2022-07-14
申请号:US17608319
申请日:2019-05-08
Applicant: Google LLC
Inventor: Dongeek Shin , Brandon Barbello , Shwetak Patel , Anupam Pathak , Michael Dixon
Abstract: Various arrangements for performing radar-based measurement of vital signs. Waveform data may be received then filtered of data indicative of static objects to obtain motion-indicative waveform data. The motion-indicative waveform data may be analyzed to determine one or more frequencies of movement present within the motion-indicative waveform data. A spectral analysis may be performed on the motion-indicative waveform data to determine a spectral-analysis state of a monitored region. The spectral-analysis state of the monitored region may be determined to match a predefined spectral-analysis state during which vital sign monitoring is permitted. One or more vital signs of a monitored user present within the monitored region may be determined and output based on analyzing the motion-indicative waveform data.
-
公开(公告)号:US20210074073A1
公开(公告)日:2021-03-11
申请号:US17099399
申请日:2020-11-16
Applicant: Google LLC
Inventor: Adam Mittleman , Jason Chamberlain , Jacobi Grillo , Daniel Biran , Mark Kraz , Lauren Chanen , Daniel Foran , David Fichou , William Dong , Bao-Tram Phan Nguyen , Brian Silverstein , Yash Modi , Alex Finlayson , Dongeek Shin
Abstract: A method for guiding installation of smart-home devices may include capturing, by a camera of a mobile computing device, a view of an installation location for a smart-home device; identifying a wire in the view of the installation location for the smart-home device; determining an instruction for connecting the wire to the smart-home device; and displaying the view of the installation location for a smart-home device with the instruction for connecting the wire to the smart-home device.
-
-
-
-
-
-
-
-
-