公开(公告)号：US20250029082A1

公开(公告)日：2025-01-23

申请号：US18906012

申请日：2024-10-03

Applicant: Maplebear Inc.

Inventor： Lin Gao ,  Yilin Huang ,  Shiyuan Yang ,  Ahmed Beshry

IPC: G06Q20/18 ,  B62B3/14 ,  G06K7/10 ,  G06K7/14 ,  G06N3/042 ,  G06N3/044 ,  G06N3/045 ,  G06N3/08 ,  G06N5/01 ,  G06N5/022 ,  G06Q20/20 ,  G06Q20/40 ,  G07G1/00 ,  G07G1/14 ,  G07G3/00

Abstract: Disclosed herein relates to a self-checkout anti-theft vehicle system, comprising: a self-checkout vehicle having a plurality of sensors and components implemented thereon, the self-checkout vehicle being used by shoppers for storing selected merchandises in a retail environment; and a centralized computing device. The centralized computing device is configured to: obtain information related to each merchandise selected and placed into the self-checkout vehicle by a shopper by exchanging data with the plurality of sensors and components via a first communication network, identify each merchandise via a second, different communication network based at least upon the information obtained from the plurality of sensors and components, and process payment information of each merchandise.

公开(公告)号：US11948044B2

公开(公告)日：2024-04-02

申请号：US18169010

申请日：2023-02-14

Applicant: Maplebear Inc.

Inventor： Ganglu Wu ,  Shiyuan Yang ,  Xiao Zhou ,  Qi Wang ,  Qunwei Liu ,  Youming Luo

IPC: G06K7/14 ,  G06Q30/0601 ,  G06T9/00 ,  G06V10/25

CPC classification number: G06K7/1413 ,  G06Q30/0633 ,  G06Q30/0641 ,  G06T9/00 ,  G06V10/25 ,  G06V2201/07

Abstract: An automated checkout system modifies received images of machine-readable labels to improve the performance of a label detection model that the system uses to decode item identifiers encoded in the machine-readable labels. For example, the automated checkout system may transform subregions of an image of a machine-readable label to adjust for distortions in the image's depiction of the machine-readable label. Similarly, the automated checkout system may identify readable regions within received images of machine-readable labels and apply a label detection model to those readable regions. By modifying received images of machine-readable labels, these techniques improve on existing computer-vision technologies by allowing for the effective decoding of machine-readable labels based on real-world images using relatively clean training data.

公开(公告)号：US20240013184A1

公开(公告)日：2024-01-11

申请号：US17874956

申请日：2022-07-27

Applicant: Maplebear Inc. (dba Instacart)

Inventor： Yilin Huang ,  Ganglu Wu ,  Xiao Zhou ,  Youming Luo ,  Shiyuan Yang

IPC: G06Q20/20 ,  G06V10/778 ,  G06V10/25 ,  G06V20/50

CPC classification number: G06Q20/208 ,  G06V10/778 ,  G06V10/25 ,  G06V20/50

Abstract: A smart shopping cart includes internally facing cameras and an integrated scale to identify objects that are placed in the cart. To avoid unnecessary processing of images that are irrelevant, and thereby save battery life, the cart uses the scale to detect when an object is placed in the cart. The cart obtains images from a cache and sends those to an object detection machine learning model. The cart captures and sends a load curve as input to the trained model for object detection. Labeled load data and labeled image data are used by a model training system to train the machine learning model to identify an item when it is added to the shopping cart. The shopping cart also uses weight data and the image data from a timeframe associated with the addition of the item to the cart as inputs.

公开(公告)号：US20230267292A1

公开(公告)日：2023-08-24

申请号：US18169010

申请日：2023-02-14

Applicant: Maplebear Inc. (dba Instacart)

Inventor： Ganglu Wu ,  Shiyuan Yang ,  Xiao Zhou ,  Qi Wang ,  Qunwei Liu ,  Youming Luo

IPC: G06K7/14 ,  G06T9/00 ,  G06V10/25 ,  G06Q30/0601

CPC classification number: G06K7/1413 ,  G06T9/00 ,  G06V10/25 ,  G06Q30/0633 ,  G06Q30/0641 ,  G06V2201/07

Abstract: An automated checkout system modifies received images of machine-readable labels to improve the performance of a label detection model that the system uses to decode item identifiers encoded in the machine-readable labels. For example, the automated checkout system may transform subregions of an image of a machine-readable label to adjust for distortions in the image's depiction of the machine-readable label. Similarly, the automated checkout system may identify readable regions within received images of machine-readable labels and apply a label detection model to those readable regions. By modifying received images of machine-readable labels, these techniques improve on existing computer-vision technologies by allowing for the effective decoding of machine-readable labels based on real-world images using relatively clean training data.

公开(公告)号：US11453426B2

公开(公告)日：2022-09-27

申请号：US16995157

申请日：2020-08-17

Applicant: Maplebear Inc.

Inventor： Lin Gao ,  Michael Joseph Sanzari ,  Yilin Huang ,  Shiyuan Yang ,  Ahmed Beshry

IPC: B62B5/00 ,  B62B3/14 ,  G01G21/00 ,  G01G19/12

Abstract: Disclosed herein relates to a system, comprising: at least one load receiver mounted on a shopping cart or basket and configured to receive an item placed into the shopping cart or basket for a weighing operation; a plurality of sensors configured to detect a plurality of parameters relating to the weighing operation of the item including at least one of: a relative angle between a force sensing axis of the at least one load receiver and a direction of gravity, a motion of the shopping cart or basket, and an ambient temperature surrounding the shopping cart or basket and the at least one load receiver; and a processor configured to determine an actual weight of the item based on at least a portion of the plurality of parameters.

公开(公告)号：US12299529B2

公开(公告)日：2025-05-13

申请号：US18587719

申请日：2024-02-26

Applicant: Maplebear Inc.

Inventor： Ganglu Wu ,  Shiyuan Yang ,  Xiao Zhou ,  Qi Wang ,  Qunwei Liu ,  Youming Luo

IPC: G06K7/14 ,  G06Q20/20 ,  G06Q30/0601 ,  G06T3/40 ,  G06T9/00 ,  G06V10/25

Abstract: An automated checkout system modifies received images of machine-readable labels to improve the performance of a label detection model that the system uses to decode item identifiers encoded in the machine-readable labels. For example, the automated checkout system may transform subregions of an image of a machine-readable label to adjust for distortions in the image's depiction of the machine-readable label. Similarly, the automated checkout system may identify readable regions within received images of machine-readable labels and apply a label detection model to those readable regions. By modifying received images of machine-readable labels, these techniques improve on existing computer-vision technologies by allowing for the effective decoding of machine-readable labels based on real-world images using relatively clean training data.

公开(公告)号：US12217236B2

公开(公告)日：2025-02-04

申请号：US17726389

申请日：2022-04-21

Applicant: Maplebear Inc.

Inventor： Shiyuan Yang ,  Shray Chandra

IPC: G06Q20/20 ,  G01G19/414 ,  G06Q20/18 ,  G06T7/10 ,  G06T7/50 ,  G06V10/10 ,  G06V10/22 ,  G06V10/70 ,  G06V10/94 ,  G06V20/60 ,  G06V20/64 ,  G07G1/00 ,  H04N23/90

Abstract: An item recognition system uses a top camera and one or more peripheral cameras to identify items. The item recognition system may use image embeddings generated based on images captured by the cameras to generate a concatenated embedding that describes an item depicted in the image. The item recognition system may compare the concatenated embedding to reference embeddings to identify the item. Furthermore, the item recognition system may detect when items are overlapping in an image. For example, the item recognition system may apply an overlap detection model to a top image and a pixel-wise mask for the top image to detect whether an item is overlapping with another in the top image. The item recognition system notifies a user of the overlap if detected.

公开(公告)号：US20240144688A1

公开(公告)日：2024-05-02

申请号：US18060473

申请日：2022-11-30

Applicant: Maplebear Inc. (dba Instacart)

Inventor： Lin Gao ,  Yilin Huang ,  Shiyuan Yang ,  Xiaofei Zhou ,  Xiao Zhou ,  Qunwei Liu

IPC: G06V20/52 ,  G06Q30/0601 ,  G06V10/74

CPC classification number: G06V20/52 ,  G06Q30/0633 ,  G06V10/761

Abstract: An automated checkout system accesses an image of an item inside a shopping cart and a location of the shopping cart within a store. The automated checkout system identifies a set of candidate items located within a threshold distance of the location of the shopping cart based on an item map. The item map describes a location of each item within the store and the location of each candidate item corresponds to a location of the candidate item on the item map. The automated checkout system inputs visual features of the item extracted from the image to a machine-learning model to identify the item by determining a similarity score between the item and each candidate item of the set of candidate items. After identifying the item, the automated checkout system displays a list comprising the item and additional items within the shopping cart to a user.

公开(公告)号：US20240135353A1

公开(公告)日：2024-04-25

申请号：US18403352

申请日：2024-01-03

Applicant: Maplebear Inc.

Inventor： Lin Gao ,  Yilin Huang ,  Shiyuan Yang ,  Ahmed Beshry

IPC: G06Q20/18 ,  B62B3/14 ,  G06K7/10 ,  G06K7/14 ,  G06N3/042 ,  G06N3/045 ,  G06N3/08 ,  G06N5/022 ,  G06Q20/20 ,  G06Q20/40 ,  G07G1/00 ,  G07G1/14 ,  G07G3/00

CPC classification number: G06Q20/18 ,  B62B3/1412 ,  B62B3/1428 ,  G06K7/10722 ,  G06K7/1417 ,  G06N3/042 ,  G06N3/045 ,  G06N3/08 ,  G06N5/022 ,  G06Q20/202 ,  G06Q20/204 ,  G06Q20/208 ,  G06Q20/401 ,  G07G1/0036 ,  G07G1/0081 ,  G07G1/009 ,  G07G1/14 ,  G07G3/003 ,  B62B2203/50 ,  G06N3/044

Abstract: Disclosed herein relates to a self-checkout anti-theft vehicle system, comprising: a self-checkout vehicle having a plurality of sensors and components implemented thereon, the self-checkout vehicle being used by shoppers for storing selected merchandises in a retail environment; and a centralized computing device. The centralized computing device is configured to: obtain information related to each merchandise selected and placed into the self-checkout vehicle by a shopper by exchanging data with the plurality of sensors and components via a first communication network, identify each merchandise via a second, different communication network based at least upon the information obtained from the plurality of sensors and components, and process payment information of each merchandise.

公开(公告)号：US11915217B2

公开(公告)日：2024-02-27

申请号：US17129437

申请日：2020-12-21

Applicant: Maplebear Inc.

Inventor： Lin Gao ,  Yilin Huang ,  Shiyuan Yang ,  Ahmed Beshry

IPC: G06Q20/18 ,  G06N3/08 ,  G06Q20/40 ,  G06K7/10 ,  G06K7/14 ,  G07G1/14 ,  G06N5/022 ,  G07G1/00 ,  G06Q20/20 ,  B62B3/14 ,  G07G3/00 ,  G06N3/042 ,  G06N3/045 ,  G06N3/044 ,  G06N5/01

CPC classification number: G06Q20/18 ,  B62B3/1412 ,  B62B3/1428 ,  G06K7/10722 ,  G06K7/1417 ,  G06N3/042 ,  G06N3/045 ,  G06N3/08 ,  G06N5/022 ,  G06Q20/202 ,  G06Q20/204 ,  G06Q20/208 ,  G06Q20/401 ,  G07G1/009 ,  G07G1/0036 ,  G07G1/0081 ,  G07G1/14 ,  G07G3/003 ,  B62B2203/50 ,  G06N3/044 ,  G06N5/01

Abstract: Disclosed herein relates to a self-checkout anti-theft vehicle system, comprising: a self-checkout vehicle having a plurality of sensors and components implemented thereon, the self-checkout vehicle being used by shoppers for storing selected merchandises in a retail environment; and a centralized computing device. The centralized computing device is configured to: obtain information related to each merchandise selected and placed into the self-checkout vehicle by a shopper by exchanging data with the plurality of sensors and components via a first communication network, identify each merchandise via a second, different communication network based at least upon the information obtained from the plurality of sensors and components, and process payment information of each merchandise.