公开(公告)号：US20240428818A1

公开(公告)日：2024-12-26

申请号：US18751015

申请日：2024-06-21

Applicant: GOOGLE LLC

Inventor： Rajeev Nongpiur ,  Neil Zeghidour ,  Marco Tagliasacchi

IPC: G10L21/0364 ,  G10L15/06 ,  G10L21/0208 ,  G10L21/0232 ,  G10L21/034 ,  G10L25/30

Abstract: A method including identifying an audio capture device and a target direction associated with the audio capture device, detecting first audio associated with the target direction, enhancing the first audio using a machine learning model configured to detect audio associated with the target direction, optionally, detecting second audio associated with a direction different from the target direction, and optionally, diminishing the second audio using the machine learning model.

公开(公告)号：US12081830B2

公开(公告)日：2024-09-03

申请号：US18351370

申请日：2023-07-12

Applicant: Google LLC

Inventor： Jessica Yuan ,  James Stewart ,  Rajeev Nongpiur ,  Patrick Lister ,  Chi Yeung Jonathan Ng

IPC: G10L17/22 ,  G06Q10/109 ,  H04L12/28 ,  H04L67/62 ,  H04N21/234 ,  H04N21/258 ,  H04N21/4223 ,  H04N21/436

CPC classification number: H04N21/43615 ,  G06Q10/109 ,  G10L17/22 ,  H04L12/2803 ,  H04L12/281 ,  H04L12/282 ,  H04L67/62 ,  H04N21/23418 ,  H04N21/25875 ,  H04N21/4223

Abstract: Various arrangements are detailed herein related to managing video recording based on spoken commands. A system receives a video stream from a video camera and analyzes a field of view in the received video stream to determine a location for one or more identified or potential users. The system can beamform audio from microphones of a home assistant device based on the location of the one or more identified or potential users. The system adjusts an audio output based on the location of the one or more identified or potential users, receives a spoken command from the one or more identified or potential users, and outputs a response to the spoken command.

公开(公告)号：US11256908B2

公开(公告)日：2022-02-22

申请号：US16883932

申请日：2020-05-26

Applicant: GOOGLE LLC

Inventor： Jason Evans Goulden ,  Rengarajan Aravamudhan ,  Hae Rim Jeong ,  Michael Dixon ,  James Edward Stewart ,  Sayed Yusef Shafi ,  Sahana Mysore ,  Seungho Yang ,  Yu-An Lien ,  Christopher Charles Burns ,  Rajeev Nongpiur ,  Jeffrey Boyd

IPC: G06K9/00 ,  G06K9/62 ,  G06T7/70 ,  G08B13/196 ,  H04M11/02 ,  G08B3/10 ,  G06K9/72

Abstract: A method of detecting and responding to a visitor to a smart home environment via an electronic greeting system of the smart home environment, including determining that a visitor is approaching an entryway of the smart home environment; initiating a facial recognition operation while the visitor is approaching the entryway; initiating an observation window in response to the determination that a visitor is approaching the entryway; obtaining context information from one or more sensors of the smart home environment during the observation window; and at the end of the time window, initiating a response to the detected approach of the visitor based on the context information and/or an outcome of the facial recognition operation.

公开(公告)号：US11134227B2

公开(公告)日：2021-09-28

申请号：US15809900

申请日：2017-11-10

Applicant: GOOGLE LLC

Inventor： Jason Evans Goulden ,  Rengarajan Aravamudhan ,  Hae Rim Jeong ,  Michael Dixon ,  James Edward Stewart ,  Sayed Yusef Shafi ,  Sahana Mysore ,  Seungho Yang ,  Yu-An Lien ,  Christopher Charles Burns ,  Rajeev Nongpiur ,  Jeffrey Boyd

IPC: H04N7/18 ,  G05B15/02 ,  G06F3/0482 ,  G06K9/78 ,  G08B7/06 ,  G06K9/00 ,  H04M11/02 ,  G08B13/196 ,  G08B3/10 ,  H04N7/14

Abstract: A method of presenting appropriate actions for responding to a visitor to a smart home environment via an electronic greeting system of the smart home environment, including detecting a visitor of the smart home environment; obtaining context information from the smart home environment regarding the visitor; based on the context information, identifying a plurality of appropriate actions available to a user of a client device for interacting with the visitor via the electronic greeting system; and causing the identified actions to be presented to the user of the client device.

公开(公告)号：US10664688B2

公开(公告)日：2020-05-26

申请号：US15809924

申请日：2017-11-10

Applicant: GOOGLE LLC

Inventor： Jason Evans Goulden ,  Rengarajan Aravamudhan ,  Haerim Jeong ,  Michael Dixon ,  James Edward Stewart ,  Sayed Yusef Shafi ,  Sahana Mysore ,  Seungho Yang ,  Yu-An Lien ,  Christopher Charles Burns ,  Rajeev Nongpiur ,  Jeffrey Boyd

IPC: G06K9/00 ,  G06K9/62 ,  G06T7/70 ,  G08B13/196 ,  H04M11/02 ,  G08B3/10 ,  G06K9/72

Abstract: A method of detecting and responding to a visitor to a smart home environment via an electronic greeting system of the smart home environment, including determining that a visitor is approaching an entryway of the smart home environment; initiating a facial recognition operation while the visitor is approaching the entryway; initiating an observation window in response to the determination that a visitor is approaching the entryway; obtaining context information from one or more sensors of the smart home environment during the observation window; and at the end of the time window, initiating a response to the detected approach of the visitor based on the context information and/or an outcome of the facial recognition operation.

公开(公告)号：US20190124393A1

公开(公告)日：2019-04-25

申请号：US16230349

申请日：2018-12-21

Applicant: Google LLC

Inventor： Jessica Yuan ,  James Stewart ,  Rajeev Nongpiur ,  Patrick Lister ,  Chi Yeung Jonathan Ng

IPC: H04N21/436 ,  H04L29/08 ,  H04L12/28 ,  G10L17/22

Abstract: Various arrangements are detailed herein related to modifying a shopping list using a home assistant device and an integrated video service. A network-enabled video camera may be used to capture a video stream of a location at which a user is present. A home assistant device may receive a spoken command that requests an item be added to a shopping list. The video stream captured using the network-enabled video camera may be analyzed to determine an identity of the user. A shopping list to modify may be determined based on the identity of the user. The determined shopping list may then be modified to indicate the item requested in the spoken command.

公开(公告)号：US20190087646A1

公开(公告)日：2019-03-21

申请号：US15809924

申请日：2017-11-10

Applicant: GOOGLE LLC

Inventor： JASON EVANS GOULDEN ,  RENGARAJAN ARAVAMUDHAN ,  Haerim Jeong ,  Michael Dixon ,  James Edward Stewart ,  Sayed Yusef Shafi ,  Sahana Mysore ,  Seungho Yang ,  Yu-An Lien ,  Christopher Charles Burns ,  Rajeev Nongpiur ,  Jeffrey Boyd

IPC: G06K9/00 ,  G06K9/72 ,  G06T7/70 ,  G06K9/62

CPC classification number: G06K9/00288 ,  G06K9/00255 ,  G06K9/00771 ,  G06K9/6201 ,  G06K9/72 ,  G06T7/70 ,  G08B3/10 ,  G08B13/19656 ,  G08B13/19684 ,  G08B13/19695 ,  H04M11/02 ,  H04M11/025

Abstract: A method of detecting and responding to a visitor to a smart home environment via an electronic greeting system of the smart home environment, including determining that a visitor is approaching an entryway of the smart home environment; initiating a facial recognition operation while the visitor is approaching the entryway; initiating an observation window in response to the determination that a visitor is approaching the entryway; obtaining context information from one or more sensors of the smart home environment during the observation window; and at the end of the time window, initiating a response to the detected approach of the visitor based on the context information and/or an outcome of the facial recognition operation.

公开(公告)号：US20250029460A1

公开(公告)日：2025-01-23

申请号：US18909632

申请日：2024-10-08

Applicant: Google LLC

Inventor： Jason Evans Goulden ,  Rengarajan Aravamudhan ,  Hae Rim Jeong ,  Michael Dixon ,  James Edward Stewart ,  Sayed Yusef Shafi ,  Sahana Mysore ,  Seungho Yang ,  Yu-An Lien ,  Christopher Charles Burns ,  Rajeev Nongpiur ,  Jeffrey Boyd

IPC: G08B3/10 ,  G06F18/22 ,  G06T7/70 ,  G06V10/70 ,  G06V20/52 ,  G06V40/16 ,  G08B13/196 ,  H04M11/02

Abstract: A method of detecting and responding to a visitor to a smart home environment via an electronic greeting system of the smart home environment, including determining that a visitor is approaching an entryway of the smart home environment; initiating a facial recognition operation while the visitor is approaching the entryway; initiating an observation window in response to the determination that a visitor is approaching the entryway; obtaining context information from one or more sensors of the smart home environment during the observation window; and at the end of the time window, initiating a response to the detected approach of the visitor based on the context information and/or an outcome of the facial recognition operation.

公开(公告)号：US11710387B2

公开(公告)日：2023-07-25

申请号：US17651781

申请日：2022-02-18

Applicant: Google LLC

Inventor： Jason Evans Goulden ,  Rengarajan Aravamudhan ,  Hae Rim Jeong ,  Michael Dixon ,  James Edward Stewart ,  Sayed Yusef Shafi ,  Sahana Mysore ,  Seungho Yang ,  Yu-An Lien ,  Christopher Charles Burns ,  Rajeev Nongpiur ,  Jeffrey Boyd

IPC: G08B3/10 ,  G06T7/70 ,  G08B13/196 ,  H04M11/02 ,  G06V40/16 ,  G06F18/22 ,  G06V10/70 ,  G06V20/52

CPC classification number: G08B3/10 ,  G06F18/22 ,  G06T7/70 ,  G06V40/166 ,  G06V40/172 ,  G08B13/19656 ,  G08B13/19684 ,  H04M11/02 ,  H04M11/025 ,  G06V10/768 ,  G06V20/52 ,  G08B13/19695

Abstract: A method of detecting and responding to a visitor to a smart home environment via an electronic greeting system of the smart home environment, including determining that a visitor is approaching an entryway of the smart home environment; initiating a facial recognition operation while the visitor is approaching the entryway; initiating an observation window in response to the determination that a visitor is approaching the entryway; obtaining context information from one or more sensors of the smart home environment during the observation window; and at the end of the time window, initiating a response to the detected approach of the visitor based on the context information and/or an outcome of the facial recognition operation.

公开(公告)号：US11303955B2

公开(公告)日：2022-04-12

申请号：US16877847

申请日：2020-05-19

Applicant: Google LLC

Inventor： Jessica Yuan ,  James Stewart ,  Rajeev Nongpiur ,  Patrick Lister ,  Chi Yeung Jonathan Ng

IPC: H04L12/28 ,  H04N21/436 ,  H04N21/234 ,  H04N21/4223 ,  G06Q10/10 ,  H04N21/258 ,  G10L17/22 ,  H04L67/62

Abstract: Various arrangements are detailed herein related to managing video recording. A system can include a network-enabled video camera that captures a video stream of a location and streams the video stream to a cloud-based home assistant integration platform. The system can include a home assistant device comprising a microphone and wireless network interface, the home assistant device configured to receive, via the microphone, a spoken command that requests video, captured by the network-enabled video camera, be recorded. The cloud-based home assistant integration platform may be configured to analyze the video stream captured using the network-enabled video camera to determine an identity of the user. The platform may be further configured to store a portion of the video stream linked to a user account of the user based on the spoken command and the identity of the user.