公开(公告)号：US20220343660A1

公开(公告)日：2022-10-27

申请号：US17726385

申请日：2022-04-21

Applicant: Maplebear Inc. (dba Instacart)

Inventor： Shiyuan Yang ,  Shray Chandra

IPC: G06V20/64 ,  G06T7/10 ,  G07G1/00

Abstract: An item recognition system uses a top camera and one or more peripheral cameras to identify items. The item recognition system may use image embeddings generated based on images captured by the cameras to generate a concatenated embedding that describes an item depicted in the image. The item recognition system may compare the concatenated embedding to reference embeddings to identify the item. Furthermore, the item recognition system may detect when items are overlapping in an image. For example, the item recognition system may apply an overlap detection model to a top image and a pixel-wise mask for the top image to detect whether an item is overlapping with another in the top image. The item recognition system notifies a user of the overlap if detected.

公开(公告)号：US12217236B2

公开(公告)日：2025-02-04

申请号：US17726389

申请日：2022-04-21

Applicant: Maplebear Inc.

Inventor： Shiyuan Yang ,  Shray Chandra

IPC: G06Q20/20 ,  G01G19/414 ,  G06Q20/18 ,  G06T7/10 ,  G06T7/50 ,  G06V10/10 ,  G06V10/22 ,  G06V10/70 ,  G06V10/94 ,  G06V20/60 ,  G06V20/64 ,  G07G1/00 ,  H04N23/90

Abstract: An item recognition system uses a top camera and one or more peripheral cameras to identify items. The item recognition system may use image embeddings generated based on images captured by the cameras to generate a concatenated embedding that describes an item depicted in the image. The item recognition system may compare the concatenated embedding to reference embeddings to identify the item. Furthermore, the item recognition system may detect when items are overlapping in an image. For example, the item recognition system may apply an overlap detection model to a top image and a pixel-wise mask for the top image to detect whether an item is overlapping with another in the top image. The item recognition system notifies a user of the overlap if detected.

公开(公告)号：US20250094956A1

公开(公告)日：2025-03-20

申请号：US18961337

申请日：2024-11-26

Applicant: Maplebear Inc.

Inventor： Shiyuan Yang ,  Shray Chandra

IPC: G06Q20/20 ,  G01G19/414 ,  G06Q20/18 ,  G06T7/10 ,  G06T7/50 ,  G06V10/10 ,  G06V10/22 ,  G06V10/70 ,  G06V10/94 ,  G06V20/60 ,  G06V20/64 ,  G07G1/00 ,  H04N23/90

Abstract: An item recognition system uses a top camera and one or more peripheral cameras to identify items. The item recognition system may use image embeddings generated based on images captured by the cameras to generate a concatenated embedding that describes an item depicted in the image. The item recognition system may compare the concatenated embedding to reference embeddings to identify the item. Furthermore, the item recognition system may detect when items are overlapping in an image. For example, the item recognition system may apply an overlap detection model to a top image and a pixel-wise mask for the top image to detect whether an item is overlapping with another in the top image. The item recognition system notifies a user of the overlap if detected.

公开(公告)号：US20220343308A1

公开(公告)日：2022-10-27

申请号：US17726389

申请日：2022-04-21

Applicant: Maplebear Inc. (dba Instacart)

Inventor： Shiyuan Yang ,  Shray Chandra

IPC: G06Q20/20 ,  H04N5/247 ,  G06V10/22 ,  G06V10/10 ,  G06V10/70 ,  G06T7/50 ,  G06V10/94 ,  G06V20/60 ,  G06Q20/18 ,  G01G19/414

Abstract: An item recognition system uses a top camera and one or more peripheral cameras to identify items. The item recognition system may use image embeddings generated based on images captured by the cameras to generate a concatenated embedding that describes an item depicted in the image. The item recognition system may compare the concatenated embedding to reference embeddings to identify the item. Furthermore, the item recognition system may detect when items are overlapping in an image. For example, the item recognition system may apply an overlap detection model to a top image and a pixel-wise mask for the top image to detect whether an item is overlapping with another in the top image. The item recognition system notifies a user of the overlap if detected.