公开(公告)号：US11170777B2

公开(公告)日：2021-11-09

申请号：US16621559

申请日：2019-05-31

Applicant: Google LLC

Inventor： Daniel Cotting ,  Zaheed Sabur ,  Lan Huo ,  Bryan Christopher Horling ,  Behshad Behzadi ,  Lucas Mirelmann ,  Michael Golikov ,  Denis Burakov ,  Steve Cheng ,  Bohdan Vlasyuk ,  Sergey Nazarov ,  Mario Bertschler ,  Luv Kothari

IPC: G10L15/22 ,  G06F3/16 ,  G10L15/18 ,  G10L15/30 ,  H04L29/08 ,  H04L29/06

Abstract: Implementations can reduce the time required to obtain responses from an automated assistant through proactive caching, locally at a client device, of proactive assistant cache entries—and through on-device utilization of the proactive assistant cache entries. Different proactive cache entries can be provided to different client devices, and various implementations relate to technique(s) utilized in determining which proactive cache entries to provide to which client devices. In some of those implementations, in determining which proactive cache entries to provide (proactively or in response to a request) to a given client device, a remote system selects, from a superset of candidate proactive cache entries, a subset of the cache entries for providing to the given client device.

公开(公告)号：US20210335356A1

公开(公告)日：2021-10-28

申请号：US17045273

申请日：2019-06-05

Applicant: Google LLC

Inventor： Denis Burakov ,  Sergey Nazarov ,  Behshad Behzadi ,  Mario Bertschler ,  Bohdan Vlasyuk ,  Daniel Cotting ,  Michael Golikov ,  Lucas Mirelmann ,  Steve Cheng ,  Zaheed Sabur ,  Okan Kolak ,  Yan Zhong ,  Vinh Quoc Ly

IPC: G10L15/22 ,  G06F3/16

Abstract: Implementations set forth herein allow a user to access a first application in a foreground of a graphical interface, and simultaneously employ an automated assistant to respond to notifications arising from a second application. The user can provide an input, such as a spoken utterance, while viewing the first application in the foreground in order to respond to notifications from the second application without performing certain intervening steps that can arise under certain circumstances. Such intervening steps can include providing a user confirmation, which can be bypassed, and/or time-limited according to a timer, which can be displayed in response to the user providing a responsive input directed at the notification. A period for the timer can be set according to one or more characteristics that are associated with the notification, the user, and/or any other information that can be associated with the user receiving the notification.

公开(公告)号：US20210216384A1

公开(公告)日：2021-07-15

申请号：US17049696

申请日：2019-08-06

Applicant: GOOGLE LLC

Inventor： Bohdan Vlasyuk ,  Behshad Behzadi ,  Mario Bertschler ,  Denis Burakov ,  Daniel Cotting ,  Michael Golikov ,  Lucas Mirelmann ,  Steve CHENG ,  Sergey NAZAROV ,  Zaheed Sabur ,  Jonathan Lee ,  Lucia Terrenghi ,  Adrian Zumbrunnen

IPC: G06F9/54 ,  G10L15/26 ,  G06F3/16 ,  G06F40/35 ,  G06F40/166 ,  G10L15/22

Abstract: Implementations set forth herein relate to an automated assistant that can be invoked while a user is interfacing with a foreground application in order to retrieve data from one or more different applications, and then provide the retrieved data to the foreground application. A user can invoke the automated assistant while operating the foreground application by providing a spoken utterance, and the automated assistant can select one or more other applications to query based on content of the spoken utterance. Application data collected by the automated assistant from the one or more other applications can then be used to provide an input to the foreground application. In this way, the user can bypass switching between applications in the foreground in order to retrieve data that has been generated by other applications.

公开(公告)号：US20210089564A1

公开(公告)日：2021-03-25

申请号：US17116296

申请日：2020-12-09

Applicant: Google LLC

Inventor： Vladimir Vuskovic ,  Joseph Lange ,  Behshad Behzadi ,  Marcin M. Nowak-Przygodzki

IPC: G06F16/332 ,  G06F16/33

Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for generating subqueries from a query. In one aspect, a method includes obtaining a query, generating a set of two subqueries from the query, where the set includes a first subquery and a second subquery, determining a quality score for the set of two subqueries, determining whether the quality score for the set of two subqueries satisfies a quality threshold, and in response to determining that the quality score for the set of two subqueries satisfies the quality threshold, providing a first response to the first subquery that is responsive to a first operation that receives the first subquery as input and providing a second response to the second subquery that is responsive to a second operation that receives the second subquery as input.

公开(公告)号：US20210074286A1

公开(公告)日：2021-03-11

申请号：US16621559

申请日：2019-05-31

Applicant: Google LLC

Inventor： Daniel Cotting ,  Zaheed Sabur ,  Lan Huo ,  Bryan Christopher Horling ,  Behshad Behzadi ,  Lucas Mirelmann ,  Michael Golikov ,  Denis Burakov ,  Steve Cheng ,  Bohdan Vlasyuk ,  Sergey Nazarov ,  Mario Bertschler ,  Luv Kothari

IPC: G10L15/22 ,  H04L29/08 ,  G10L15/18 ,  G06F3/16 ,  G10L15/30

Abstract: Implementations can reduce the time required to obtain responses from an automated assistant through proactive caching, locally at a client device, of proactive assistant cache entries—and through on-device utilization of the proactive assistant cache entries. Different proactive cache entries can be provided to different client devices, and various implementations relate to technique(s) utilized in determining which proactive cache entries to provide to which client devices. In some of those implementations, in determining which proactive cache entries to provide (proactively or in response to a request) to a given client device, a remote system selects, from a superset of candidate proactive cache entries, a subset of the cache entries for providing to the given client device.

公开(公告)号：US20210074285A1

公开(公告)日：2021-03-11

申请号：US16621540

申请日：2019-05-31

Applicant: Google LLC

Inventor： Michael Golikov ,  Zaheed Sabur ,  Denis Burakov ,  Behshad Behzadi ,  Sergey Nazarov ,  Daniel Cotting ,  Mario Bertschler ,  Lucas Mirelmann ,  Steve Cheng ,  Bohdan Vlasyuk ,  Jonathan Lee ,  Lucia Terrenghi ,  Adrian Zumbrunnen

IPC: G10L15/22 ,  G10L15/06 ,  G10L25/78 ,  G10L15/18 ,  G10L15/183 ,  G06F3/16 ,  G01D21/02

Abstract: Implementations can reduce the time required to obtain responses from an automated assistant by, for example, obviating the need to provide an explicit invocation to the automated assistant, such as by saying a hot-word/phrase or performing a specific user input, prior to speaking a command or query. In addition, the automated assistant can optionally receive, understand, and/or respond to the command or query without communicating with a server, thereby further reducing the time in which a response can be provided. Implementations only selectively initiate on-device speech recognition responsive to determining one or more condition(s) are satisfied. Further, in some implementations, on-device NLU, on-device fulfillment, and/or resulting execution occur only responsive to determining, based on recognized text form the on-device speech recognition, that such further processing should occur. Thus, through selective activation of on-device speech processing, and/or selective activation of on-device NLU and/or on-device fulfillment, various client device resources are conserved.

公开(公告)号：US10860799B2

公开(公告)日：2020-12-08

申请号：US15991513

申请日：2018-05-29

Applicant: Google LLC

Inventor： Mugurel Ionut Andreica ,  Tatsiana Sakhar ,  Behshad Behzadi ,  Marcin M. Nowak-Przygodzki ,  Adrian-Marius Dumitran

IPC: G06F17/27 ,  G06F40/295 ,  G06F16/31 ,  G06F16/332 ,  G06F40/211 ,  G06F17/21

Abstract: In some implementations, a query that includes a sequence of terms is obtained, the query is mapped, based on the sequence of the terms, to a dependency tree that represents dependencies among the terms in the query, an entity type that corresponds to an entity sought by the query is determined based on a term represented by a root of the dependency tree, a particular entity is identified based on both the entity type and a relevance of the entity to the terms in the query, and a response to the query is provided based on the particular entity that is identified.

公开(公告)号：US20200236069A1

公开(公告)日：2020-07-23

申请号：US16832637

申请日：2020-03-27

Applicant: Google LLC

Inventor： Marcin Nowak-Przygodzki ,  Jan Lamecki ,  Behshad Behzadi

IPC: H04L12/58 ,  H04L12/18 ,  G10L15/18 ,  G10L15/22 ,  G06Q10/10 ,  H04M3/493 ,  H04M3/527

Abstract: Techniques are described related to enabling automated assistants to enter into a “conference mode” in which they can “participate” in meetings between multiple human participants and perform various functions described herein. In various implementations, an automated assistant implemented at least in part on conference computing device(s) may be set to a conference mode in which the automated assistant performs speech-to-text processing on multiple distinct spoken utterances, provided by multiple meeting participants, without requiring explicit invocation prior to each utterance. The automated assistant may perform semantic processing on first text generated from the speech-to-text processing of one or more of the spoken utterances, and generate, based on the semantic processing, data that is pertinent to the first text. The data may be output to the participants at conference computing device(s). The automated assistant may later determine that the meeting has concluded, and may be set to a non-conference mode.

公开(公告)号：US10691680B1

公开(公告)日：2020-06-23

申请号：US15617184

申请日：2017-06-08

Applicant: Google LLC

Inventor： Matthias Heiler ,  Behshad Behzadi ,  Evgeny A. Cherepanov ,  Nils Grimsmo ,  Aurelien Boffy ,  Alessandro Agostini ,  Karoly Csalogany ,  Fredrik Bergenlid ,  Marcin M. Nowak-Przygodzki

IPC: G06F16/242 ,  G06F16/23 ,  G06F16/248 ,  G06F16/9535 ,  G06F16/2457 ,  G06F16/9032

Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for determining query refinements using search data. In one aspect, a method includes receiving a first query and a second query each comprising one or more n-grams for a user session, determining a first set of query refinements for the first query, determining a second set of query refinements from the first set of query refinements, each query refinement in the second set of query refinements including at least one n-gram that is similar to an n-gram from the first query and at least on n-gram that is similar to an n-gram from the second query, scoring each query refinement in the second set of query refinements, selecting a third query from a group consisting of the second set of query refinements and the second query, and providing the third query as input to a search operation.

公开(公告)号：US10204104B2

公开(公告)日：2019-02-12

申请号：US14686428

申请日：2015-04-14

Applicant: Google LLC

Inventor： Alexander Taboriskiy ,  Emmanuel Mogenet ,  Oliver Heckmann ,  Matsvei Zhdanovich ,  Gokhan Hasan Bakir ,  Behshad Behzadi ,  Karoly Csalogany

IPC: H04N21/422 ,  G06F17/30 ,  H04N21/4722

Abstract: Methods, systems, and media for processing queries relating to presented media content are provided. In some implementations, a method comprises: receiving a request to associate with a media playback device that is presenting media content to a user of the mobile device; activating a microphone associated with the mobile device; converting received ambient sounds to text inputs; determining whether the text inputs include a trigger term and the query; determining media playback information from the media application that includes timing information corresponding to when during the presentation of the media content the query was received and media content identification information; causing a search to be performed that includes the query, the timing information, and the media content identification information; obtaining a search result that is responsive to the query; and presenting the search result on a display associated with the mobile device.