公开(公告)号：US09753951B1

公开(公告)日：2017-09-05

申请号：US15220671

申请日：2016-07-27

Applicant: Google Inc.

Inventor： Yuan Li ,  Taehee Lee ,  Hartwig Adam

IPC: G06F17/30

CPC classification number: G06F17/30277 ,  G06F17/30247 ,  G06F17/3025 ,  G06F17/30256 ,  G06F17/30268 ,  G06F17/3053 ,  G06F17/30554 ,  G06F17/3087

Abstract: A system and computer-implemented method is provided for organizing multiple user submitted results responsive to an image query. A plurality of content submissions may be received from a variety of submitting users, each content submission including an image and an associated label. An image query may provide an image of an object as a request to identify the object. In response to receiving the image query, one or more results of the plurality of content submissions may be identified. A similarity between the labels for each of the one or more results may be determined and used to group the one or more results. Grouped results may be ranked and sorted for accurate and concise presentation to a querying user.

公开(公告)号：US09424279B2

公开(公告)日：2016-08-23

申请号：US13790024

申请日：2013-03-08

Applicant: Google Inc.

Inventor： Yuan Li ,  Taehee Lee ,  Hartwig Adam

IPC: G06F17/30

CPC classification number: G06F17/30277 ,  G06F17/30247 ,  G06F17/3025 ,  G06F17/30256 ,  G06F17/30268 ,  G06F17/3053 ,  G06F17/30554 ,  G06F17/3087

Abstract: A system and computer-implemented method is provided for organizing multiple user submitted results responsive to an image query. A plurality of content submissions may be received from a variety of submitting users, each content submission including an image and an associated label. An image query may provide an image of an object as a request to identify the object. In response to receiving the image query, one or more results of the plurality of content submissions may be identified. A similarity between the labels for each of the one or more results may be determined and used to group the one or more results. Grouped results may be ranked and sorted for accurate and concise presentation to a querying user.

Abstract translation: 提供了系统和计算机实现的方法，用于响应于图像查询来组织多个用户提交的结果。 可以从各种提交用户接收多个内容提交，每个内容提交包括图像和相关联的标签。 图像查询可以将对象的图像提供为识别对象的请求。 响应于接收到图像查询，可以识别多个内容提交中的一个或多个结果。 可以确定一个或多个结果中的每一个的标签之间的相似性，并用于对一个或多个结果进行分组。 分组的结果可能会排序并排序，以便准确和简明的呈现给查询用户。

公开(公告)号：US09117146B2

公开(公告)日：2015-08-25

申请号：US14145279

申请日：2013-12-31

Applicant: Google Inc.

Inventor： Yuan Li ,  Hartwig Adam

IPC: G06K9/62 ,  G06K9/00

CPC classification number: G06K9/6256 ,  G06K9/00624 ,  G06K9/00718 ,  G06K9/6201

Abstract: Systems and methods for modeling the occurrence of common image components (e.g., sub-regions) in order to improve visual object recognition are disclosed. In one example, a query image may be matched to a training image of an object. A matched region within the training image to which the query image matches may be determined and a determination may be made whether the matched region is located within an annotated image component of the training image. When the matched region matches only to the image component, an annotation associated with the component may be identified. In another example, sub-regions within a plurality of training image corpora may be annotated as common image components including associated information (e.g., metadata). Matching sub-regions appearing in many training images of objects may be down-weighted in the matching process to reduce possible false matches to query images including common image components.

Abstract translation: 公开了用于对共同图像分量（例如，子区域）的发生进行建模以便改进视觉对象识别的系统和方法。 在一个示例中，查询图像可以与对象的训练图像匹配。 可以确定训练图像中与查询图像匹配的匹配区域，并且可以确定匹配区域是否位于训练图像的注释图像分量内。 当匹配区域仅与图像分量匹配时，可以识别与该组件相关联的注释。 在另一示例中，多个训练图像语料库中的子区域可以被注释为包括关联信息（例如，元数据）的公共图像分量。 出现在对象的许多训练图像中的匹配子区域可以在匹配处理中被加权，以减少对包括公共图像分量的查询图像的可能的假匹配。

公开(公告)号：US20150169634A1

公开(公告)日：2015-06-18

申请号：US14446519

申请日：2014-07-30

Applicant: Google Inc.

Inventor： Yuan Li ,  Hartwig Adam

IPC: G06F17/30

CPC classification number: G06F17/30247 ,  G06F17/30265 ,  G06F17/3028 ,  G06F17/30598 ,  G06K9/00536 ,  G06K9/6255 ,  G06K9/6807 ,  G06K2209/21

Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for automatically extracting logos from images. Methods include generating a query list including a plurality of logo search queries, for each logo search query of the plurality of logo search queries: generating a plurality of image search results, each image search result including image data, and clustering the plurality of image search results into a plurality of clusters, each cluster including a plurality of images of the plurality of image search results, extracting, for each cluster of the plurality of clusters, a representative image to provide a plurality of representative images, and a name corresponding to the representative image to provide a plurality of names, and providing the plurality of representative images and the plurality of names to a logo index, the logo index being accessible to identify one or more logo images in a query image.

Abstract translation: 方法，系统和装置，包括在计算机存储介质上编码的计算机程序，用于从图像自动提取徽标。 方法包括为多个标识搜索查询的每个标识搜索查询生成包括多个徽标搜索查询的查询列表：生成多个图像搜索结果，每个图像搜索结果包括图像数据，并且对多个图像搜索进行聚类 结果为多个群集，每个群集包括所述多个图像搜索结果的多个图像，针对所述多个群集中的每个群集提取代表图像以提供多个代表图像，以及与所述多个群集对应的名称 代表性图像以提供多个名称，并且将多个代表图像和多个名称提供给标识索引，所述标识索引可被访问以识别查询图像中的一个或多个标志图像。

公开(公告)号：US20140112576A1

公开(公告)日：2014-04-24

申请号：US14145279

申请日：2013-12-31

Applicant: Google Inc.

Inventor： Yuan Li ,  Hartwig Adam

IPC: G06K9/62

CPC classification number: G06K9/6256 ,  G06K9/00624 ,  G06K9/00718 ,  G06K9/6201

Abstract: Systems and methods for modeling the occurrence of common image components (e.g., sub-regions) in order to improve visual object recognition are disclosed. In one example, a query image may be matched to a training image of an object. A matched region within the training image to which the query image matches may be determined and a determination may be made whether the matched region is located within an annotated image component of the training image. When the matched region matches only to the image component, an annotation associated with the component may be identified. In another example, sub-regions within a plurality of training image corpora may be annotated as common image components including associated information (e.g., metadata). Matching sub-regions appearing in many training images of objects may be down-weighted in the matching process to reduce possible false matches to query images including common image components.

Abstract translation: 公开了用于对共同图像分量（例如，子区域）的发生进行建模以便改进视觉对象识别的系统和方法。 在一个示例中，查询图像可以与对象的训练图像匹配。 可以确定训练图像中与查询图像匹配的匹配区域，并且可以确定匹配区域是否位于训练图像的注释图像分量内。 当匹配区域仅与图像分量匹配时，可以识别与该组件相关联的注释。 在另一示例中，多个训练图像语料库中的子区域可以被注释为包括关联信息（例如，元数据）的公共图像分量。 出现在对象的许多训练图像中的匹配子区域可以在匹配处理中被加权，以减少对包括公共图像分量的查询图像的可能的假匹配。

公开(公告)号：US20140086481A1

公开(公告)日：2014-03-27

申请号：US14045207

申请日：2013-10-03

Applicant: Google Inc.

Inventor： Yuan Li ,  Hartwig Adam

IPC: G06K9/66

CPC classification number: G06K9/66 ,  G06K9/6256

Abstract: Systems and methods for improving visual object recognition by analyzing query images are disclosed. In one example, a visual object recognition module may determine query images matching objects of a training corpus utilized by the module. Matched query images may be added to the training corpus as training images of a matched object to expand the recognition of the object by the module. In another example, relevant candidate image corpora from a pool of image data may be automatically selected by matching the candidate image corpora against user query images. Selected image corpora may be added to a training corpus to improve recognition coverage. In yet another example, objects unknown to a visual object recognition module may be discovered by clustering query images. Clusters of similar query images may be annotated and added into a training corpus to improve recognition coverage.

Abstract translation: 公开了通过分析查询图像来改善视觉对象识别的系统和方法。 在一个示例中，视觉对象识别模块可以确定与模块使用的训练语料库匹配对象的查询图像。 可将匹配的查询图像作为匹配对象的训练图像添加到训练语料库，以扩展该模块对对象的识别。 在另一示例中，可以通过将候选图像语料库与用户查询图像进行匹配来自动选择来自图像数据池的相关候选图像语料库。 可以将选定的图像语料库添加到训练语料库中以改善识别覆盖。 在又一示例中，可视物体识别模块未知的对象可以通过聚类查询图像来发现。 类似查询图像的群集可以被注释并添加到训练语料库中以改善识别覆盖。

公开(公告)号：US09280561B2

公开(公告)日：2016-03-08

申请号：US14446519

申请日：2014-07-30

Applicant: Google Inc.

Inventor： Yuan Li ,  Hartwig Adam

IPC: G06F17/30 ,  G06K9/00 ,  G06K9/62 ,  G06K9/68

CPC classification number: G06F17/30247 ,  G06F17/30265 ,  G06F17/3028 ,  G06F17/30598 ,  G06K9/00536 ,  G06K9/6255 ,  G06K9/6807 ,  G06K2209/21

Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for automatically extracting logos from images. Methods include generating a query list including a plurality of logo search queries, for each logo search query of the plurality of logo search queries: generating a plurality of image search results, each image search result including image data, and clustering the plurality of image search results into a plurality of clusters, each cluster including a plurality of images of the plurality of image search results, extracting, for each cluster of the plurality of clusters, a representative image to provide a plurality of representative images, and a name corresponding to the representative image to provide a plurality of names, and providing the plurality of representative images and the plurality of names to a logo index, the logo index being accessible to identify one or more logo images in a query image.

公开(公告)号：US09171018B2

公开(公告)日：2015-10-27

申请号：US13742791

申请日：2013-01-16

Applicant: Google Inc.

Inventor： Maks Ovsjanikov ,  Yuan Li ,  Hartwig Adam ,  Charles Joseph Rosenberg

IPC: G06F17/30

CPC classification number: G06F17/30256 ,  G06F17/30247 ,  G06F17/30277 ,  G06F17/3053 ,  G06F17/30542 ,  G06F17/30867

Abstract: A system and computer-implemented method for associating images with semantic entities and providing search results using the semantic entities. An image database contains one or more source images associated with one or more images labels. A computer may generate one or more documents containing the labels associated with each image. Analysis may be performed on the one or more documents to associate the source images with semantic entities. The semantic entities may be used to provide search results. In response to receiving a target image as a search query, the target image may be compared with the source images to identify similar images. The semantic entities associated with the similar images may be used to determine a semantic entity for the target image. The semantic entity for the target image may be used to provide search results in response to the search initiated by the target image.

Abstract translation: 一种用于将图像与语义实体相关联并使用语义实体提供搜索结果的系统和计算机实现的方法。 图像数据库包含与一个或多个图像标签相关联的一个或多个源图像。 计算机可以生成包含与每个图像相关联的标签的一个或多个文档。 可以对一个或多个文档执行分析，以将源图像与语义实体相关联。 语义实体可以用于提供搜索结果。 响应于接收目标图像作为搜索查询，可以将目标图像与源图像进行比较以识别相似的图像。 与相似图像相关联的语义实体可以用于确定目标图像的语义实体。 用于目标图像的语义实体可以用于响应于由目标图像发起的搜索来提供搜索结果。

公开(公告)号：US09098552B2

公开(公告)日：2015-08-04

申请号：US13759631

申请日：2013-02-05

Applicant: Google Inc.

Inventor： Hartwig Adam ,  Sylvain Gelly ,  Yuan Li ,  Taehee Lee

IPC: G06F17/30

CPC classification number: G06F17/30244 ,  G06F17/30256 ,  G06F17/30265

Abstract: Methods, systems, and apparatus for scoring images related to entities. In one aspect, a method includes identifying images associated with a person, each image being included in one or more resources; obtaining, for each resource that includes one of the images, a quality score that represents a quality of the resource; for each of the images: generating an image resource quality score from the quality scores of the resources that include the image; identifying a set of similar images from the images, each similar image having a measure of similarity to the image that meets a similarity measure threshold; generating an image score based on image resource quality scores of the resources that include the similar images relative to image resource quality scores of the resources that include each of the images; and generating an image authority score based on the image resource quality score and the image score.

Abstract translation: 用于评分与实体有关的图像的方法，系统和装置。 一方面，一种方法包括识别与人相关联的图像，每个图像被包括在一个或多个资源中; 对于包括所述图像之一的每个资源，获得表示所述资源质量的质量分数; 对于每个图像：从包括图像的资源的质量得分生成图像资源质量得分; 从所述图像识别一组相似的图像，每个相似图像具有与满足相似性测量阈值的图像相似度的度量; 基于包括相似图像的资源的图像资源质量得分相对于包括每个图像的资源的图像资源质量得分来生成图像分数; 以及基于图像资源质量得分和图像得分生成图像授权分数。

公开(公告)号：US20150169575A1

公开(公告)日：2015-06-18

申请号：US13759631

申请日：2013-02-05

Applicant: Google Inc.

Inventor： Hartwig Adam ,  Sylvain Gelly ,  Yuan Li ,  Taehee Lee

IPC: G06F17/30

CPC classification number: G06F17/30244 ,  G06F17/30256 ,  G06F17/30265

Abstract: Methods, systems, and apparatus for scoring images related to entities. In one aspect, a method includes identifying images associated with a person, each image being included in one or more resources; obtaining, for each resource that includes one of the images, a quality score that represents a quality of the resource; for each of the images: generating an image resource quality score from the quality scores of the resources that include the image; identifying a set of similar images from the images, each similar image having a measure of similarity to the image that meets a similarity measure threshold; generating an image score based on image resource quality scores of the resources that include the similar images relative to image resource quality scores of the resources that include each of the images; and generating an image authority score based on the image resource quality score and the image score.

Abstract translation: 用于评分与实体有关的图像的方法，系统和装置。 一方面，一种方法包括识别与人相关联的图像，每个图像被包括在一个或多个资源中; 对于包括所述图像之一的每个资源，获得表示所述资源质量的质量分数; 对于每个图像：从包括图像的资源的质量得分生成图像资源质量得分; 从所述图像识别一组相似的图像，每个相似图像具有与满足相似性测量阈值的图像相似度的度量; 基于包括相似图像的资源的图像资源质量得分相对于包括每个图像的资源的图像资源质量得分来生成图像分数; 以及基于图像资源质量得分和图像得分生成图像授权分数。