HAND GESTURE RECOGNITION BASED ON DETECTED WRIST MUSCULAR MOVEMENTS

    公开(公告)号:US20230393665A1

    公开(公告)日:2023-12-07

    申请号:US18174358

    申请日:2023-02-24

    Applicant: GOOGLE LLC

    CPC classification number: G06F3/017 G06F1/163 G06F3/014 G06V40/28

    Abstract: Techniques of identifying gestures include detecting and classifying inner-wrist muscle motions at a user's wrist using micron-resolution radar sensors. For example, a user of an AR system may wear a band around their wrist. When the user makes a gesture to manipulate a virtual object in the AR system as seen in a head-mounted display (HMD), muscles and ligaments in the user's wrist make small movements on the order of 1-3 mm. The band contains a small radar device that has a transmitter and a number of receivers (e.g., three) of electromagnetic (EM) radiation on a chip (e.g., a Soli chip. This radiation reflects off the wrist muscles and ligaments and is received by the receivers on the chip in the band. The received reflected signal, or signal samples, are then sent to processing circuitry for classification to identify the wrist movement as a gesture.

    Passive-accessory mediated gesture interaction with a head-mounted device

    公开(公告)号:US11822736B1

    公开(公告)日:2023-11-21

    申请号:US17663978

    申请日:2022-05-18

    Applicant: Google LLC

    CPC classification number: G06F3/0346 G06F3/012 G06F3/017 G06F2203/0331

    Abstract: Physical gestures may be performed by a user to interact with a head-mounted device. These physical gestures can be detected by other devices worn by the user. For example, a fitness tracker worn on a wrist of a user may be used to detect the movement of the wrist as a gesture and then communicate this gesture to the head-mounted device. This accessory-mediated gesture interaction may be interrupted when the accessory device loses power or otherwise stops tracking. In this condition, the disclosed head-mounted device may take-over gesture detection by monitoring distortions to a magnetic field caused by movement of the device. This form of gesture detection can be used when an active device has exhausted its battery. Further, this form of gesture detection can be used for electrically inactive objects that can cause detectable changes to the magnetic field when moved in the magnetic field.

    Contextual Assistant Using Mouse Pointing or Touch Cues

    公开(公告)号:US20230325148A1

    公开(公告)日:2023-10-12

    申请号:US18331643

    申请日:2023-06-08

    Applicant: Google LLC

    Inventor: Dongeek Shin

    Abstract: A method for a contextual assistant to use mouse pointing or touch cues includes receiving audio data corresponding to a query spoken by a user, receiving, in a graphical user interface displayed on a screen, a user input indication indicating a spatial input applied at a first location on the screen, and processing the audio data to determine a transcription of the query. The method also includes performing query interpretation on the transcription to determine that the query is referring to an object displayed on the screen without uniquely identifying the object, and requesting information about the object. The method further includes disambiguating, using the user input indication indicating the spatial input applied at the first location on the screen, the query to uniquely identify the object that the query is referring to, obtaining the information about the object requested by the query, and providing a response to the query.

    RADAR-BASED SLEEP MONITORING TRAINED USING NON-RADAR POLYSOMNOGRAPHY DATASETS

    公开(公告)号:US20230316142A1

    公开(公告)日:2023-10-05

    申请号:US18130731

    申请日:2023-04-04

    Applicant: Google LLC

    CPC classification number: G06N20/00

    Abstract: Various arrangements are presented for training and using a machine learning model. A first training data set may be created that has more samples but fewer dimensions than a second dataset. A second set of training data, created from the second dataset, has at least one additional dimension of data than the first set of training data. An additional dimension of data can then be simulated for the first set of training data. The simulated additional dimension of data can be incorporated with the first set of training data. A first machine learning model can be trained based on the first set of training data that comprises the simulated additional dimension of data to obtain various weights. A second machine learning model can then be trained based on the second set of training data and the obtained plurality of weights from the first trained machine learning model.

    Speech Recognition Using Word or Phoneme Time Markers Based on User Input

    公开(公告)号:US20230306965A1

    公开(公告)日:2023-09-28

    申请号:US18161871

    申请日:2023-01-30

    Applicant: Google LLC

    Inventor: Dongeek Shin

    Abstract: A method for separating target speech from background noise contained in an input audio signal includes receiving the input audio signal captured by a user device, wherein the input audio signal corresponds to target speech of multiple words spoken by a target user and containing background noise in the presence of the user device while the target user spoke the multiple words in the target speech. The method also includes receiving a sequence of time markers input by the target user in cadence with the target user speaking the multiple words in the target speech, and correlating the sequence of time markers with the input audio signal to generate enhanced audio features that separate the target speech from the background noise in the input audio signal. The method also includes processing, using a speech recognition model, the enhanced audio features to generate a transcription of the target speech.

    Contextual assistant using mouse pointing or touch cues

    公开(公告)号:US11709653B1

    公开(公告)日:2023-07-25

    申请号:US17717292

    申请日:2022-04-11

    Applicant: Google LLC

    Inventor: Dongeek Shin

    Abstract: A method for a contextual assistant to use mouse pointing or touch cues includes receiving audio data corresponding to a query spoken by a user, receiving, in a graphical user interface displayed on a screen, a user input indication indicating a spatial input applied at a first location on the screen, and processing the audio data to determine a transcription of the query. The method also includes performing query interpretation on the transcription to determine that the query is referring to an object displayed on the screen without uniquely identifying the object, and requesting information about the object. The method further includes disambiguating, using the user input indication indicating the spatial input applied at the first location on the screen, the query to uniquely identify the object that the query is referring to, obtaining the information about the object requested by the query, and providing a response to the query.

    Touch pressure input for devices
    88.
    发明授权

    公开(公告)号:US11543892B2

    公开(公告)日:2023-01-03

    申请号:US17302258

    申请日:2021-04-28

    Applicant: GOOGLE LLC

    Abstract: A computing device, such as a wearable device, may include at least two electrodes mounted on a body. The computing device may determine an electrical signal associated with a circuit that includes the at least two electrodes and the user. A pressure applied to at least one electrode of the at least two electrodes may be determined from the electrical signal, and at least one function of the computing device may be implemented, based on the pressure.

    SLEEP TRACKING AND VITAL SIGN MONITORING USING LOW POWER RADIO WAVES

    公开(公告)号:US20220218224A1

    公开(公告)日:2022-07-14

    申请号:US17608319

    申请日:2019-05-08

    Applicant: Google LLC

    Abstract: Various arrangements for performing radar-based measurement of vital signs. Waveform data may be received then filtered of data indicative of static objects to obtain motion-indicative waveform data. The motion-indicative waveform data may be analyzed to determine one or more frequencies of movement present within the motion-indicative waveform data. A spectral analysis may be performed on the motion-indicative waveform data to determine a spectral-analysis state of a monitored region. The spectral-analysis state of the monitored region may be determined to match a predefined spectral-analysis state during which vital sign monitoring is permitted. One or more vital signs of a monitored user present within the monitored region may be determined and output based on analyzing the motion-indicative waveform data.

Patent Agency Ranking