-
公开(公告)号:US20240144688A1
公开(公告)日:2024-05-02
申请号:US18060473
申请日:2022-11-30
Applicant: Maplebear Inc. (dba Instacart)
Inventor: Lin Gao , Yilin Huang , Shiyuan Yang , Xiaofei Zhou , Xiao Zhou , Qunwei Liu
IPC: G06V20/52 , G06Q30/0601 , G06V10/74
CPC classification number: G06V20/52 , G06Q30/0633 , G06V10/761
Abstract: An automated checkout system accesses an image of an item inside a shopping cart and a location of the shopping cart within a store. The automated checkout system identifies a set of candidate items located within a threshold distance of the location of the shopping cart based on an item map. The item map describes a location of each item within the store and the location of each candidate item corresponds to a location of the candidate item on the item map. The automated checkout system inputs visual features of the item extracted from the image to a machine-learning model to identify the item by determining a similarity score between the item and each candidate item of the set of candidate items. After identifying the item, the automated checkout system displays a list comprising the item and additional items within the shopping cart to a user.
-
公开(公告)号:US20240135353A1
公开(公告)日:2024-04-25
申请号:US18403352
申请日:2024-01-03
Applicant: Maplebear Inc.
Inventor: Lin Gao , Yilin Huang , Shiyuan Yang , Ahmed Beshry
IPC: G06Q20/18 , B62B3/14 , G06K7/10 , G06K7/14 , G06N3/042 , G06N3/045 , G06N3/08 , G06N5/022 , G06Q20/20 , G06Q20/40 , G07G1/00 , G07G1/14 , G07G3/00
CPC classification number: G06Q20/18 , B62B3/1412 , B62B3/1428 , G06K7/10722 , G06K7/1417 , G06N3/042 , G06N3/045 , G06N3/08 , G06N5/022 , G06Q20/202 , G06Q20/204 , G06Q20/208 , G06Q20/401 , G07G1/0036 , G07G1/0081 , G07G1/009 , G07G1/14 , G07G3/003 , B62B2203/50 , G06N3/044
Abstract: Disclosed herein relates to a self-checkout anti-theft vehicle system, comprising: a self-checkout vehicle having a plurality of sensors and components implemented thereon, the self-checkout vehicle being used by shoppers for storing selected merchandises in a retail environment; and a centralized computing device. The centralized computing device is configured to: obtain information related to each merchandise selected and placed into the self-checkout vehicle by a shopper by exchanging data with the plurality of sensors and components via a first communication network, identify each merchandise via a second, different communication network based at least upon the information obtained from the plurality of sensors and components, and process payment information of each merchandise.
-
公开(公告)号:US11915217B2
公开(公告)日:2024-02-27
申请号:US17129437
申请日:2020-12-21
Applicant: Maplebear Inc.
Inventor: Lin Gao , Yilin Huang , Shiyuan Yang , Ahmed Beshry
IPC: G06Q20/18 , G06N3/08 , G06Q20/40 , G06K7/10 , G06K7/14 , G07G1/14 , G06N5/022 , G07G1/00 , G06Q20/20 , B62B3/14 , G07G3/00 , G06N3/042 , G06N3/045 , G06N3/044 , G06N5/01
CPC classification number: G06Q20/18 , B62B3/1412 , B62B3/1428 , G06K7/10722 , G06K7/1417 , G06N3/042 , G06N3/045 , G06N3/08 , G06N5/022 , G06Q20/202 , G06Q20/204 , G06Q20/208 , G06Q20/401 , G07G1/009 , G07G1/0036 , G07G1/0081 , G07G1/14 , G07G3/003 , B62B2203/50 , G06N3/044 , G06N5/01
Abstract: Disclosed herein relates to a self-checkout anti-theft vehicle system, comprising: a self-checkout vehicle having a plurality of sensors and components implemented thereon, the self-checkout vehicle being used by shoppers for storing selected merchandises in a retail environment; and a centralized computing device. The centralized computing device is configured to: obtain information related to each merchandise selected and placed into the self-checkout vehicle by a shopper by exchanging data with the plurality of sensors and components via a first communication network, identify each merchandise via a second, different communication network based at least upon the information obtained from the plurality of sensors and components, and process payment information of each merchandise.
-
公开(公告)号:US20220410955A1
公开(公告)日:2022-12-29
申请号:US17821876
申请日:2022-08-24
Applicant: Maplebear Inc. (dba Instacart)
Inventor: Lin Gao , Michael Joseph Sanzari , Yilin Huang , Shiyuan Yang , Ahmed Beshry
Abstract: Disclosed herein relates to a system, comprising: at least one load receiver mounted on a shopping cart or basket and configured to receive an item placed into the shopping cart or basket for a weighing operation; a plurality of sensors configured to detect a plurality of parameters relating to the weighing operation of the item including at least one of: a relative angle between a force sensing axis of the at least one load receiver and a direction of gravity, a motion of the shopping cart or basket, and an ambient temperature surrounding the shopping cart or basket and the at least one load receiver; and a processor configured to determine an actual weight of the item based on at least a portion of the plurality of parameters.
-
公开(公告)号:US20220309264A1
公开(公告)日:2022-09-29
申请号:US17703076
申请日:2022-03-24
Applicant: Maplebear Inc. (dba Instacart)
Inventor: Shiyuan Yang , Yilin Huang , Wentao Pan , Xiao Zhou
Abstract: A barcode decoding system decodes item identifiers from images of barcodes. The barcode decoding system receives an image of a barcode and rotates the image to a pre-determined orientation. The barcode decoding system also may segment the barcode image to emphasize the portions of the image that correspond to the barcode. The barcode decoding system generates a binary sequence representation of the item identifier encoded in the barcode by applying a barcode classifier model to the barcode image, and decodes the item identifier from the barcode based on the binary sequence representation.
-
公开(公告)号:US12205098B2
公开(公告)日:2025-01-21
申请号:US17874956
申请日:2022-07-27
Applicant: Maplebear Inc.
Inventor: Yilin Huang , Ganglu Wu , Xiao Zhou , Youming Luo , Shiyuan Yang
Abstract: A smart shopping cart includes internally facing cameras and an integrated scale to identify objects that are placed in the cart. To avoid unnecessary processing of images that are irrelevant, and thereby save battery life, the cart uses the scale to detect when an object is placed in the cart. The cart obtains images from a cache and sends those to an object detection machine learning model. The cart captures and sends a load curve as input to the trained model for object detection. Labeled load data and labeled image data are used by a model training system to train the machine learning model to identify an item when it is added to the shopping cart. The shopping cart also uses weight data and the image data from a timeframe associated with the addition of the item to the cart as inputs.
-
公开(公告)号:US12197998B2
公开(公告)日:2025-01-14
申请号:US18398739
申请日:2023-12-28
Applicant: Maplebear Inc.
Inventor: Shiyuan Yang , Yilin Huang , Wentao Pan , Xiao Zhou
Abstract: A barcode decoding system decodes item identifiers from images of barcodes. The barcode decoding system receives an image of a barcode and rotates the image to a pre-determined orientation. The barcode decoding system also may segment the barcode image to emphasize the portions of the image that correspond to the barcode. The barcode decoding system generates a binary sequence representation of the item identifier encoded in the barcode by applying a barcode classifier model to the barcode image, and decodes the item identifier from the barcode based on the binary sequence representation.
-
公开(公告)号:US20240135123A1
公开(公告)日:2024-04-25
申请号:US18398739
申请日:2023-12-28
Applicant: Maplebear Inc.
Inventor: Shiyuan Yang , Yilin Huang , Wentao Pan , Xiao Zhou
CPC classification number: G06K7/1413 , G06T7/10 , G06F2218/12 , G06T2207/20081
Abstract: A barcode decoding system decodes item identifiers from images of barcodes. The barcode decoding system receives an image of a barcode and rotates the image to a pre-determined orientation. The barcode decoding system also may segment the barcode image to emphasize the portions of the image that correspond to the barcode. The barcode decoding system generates a binary sequence representation of the item identifier encoded in the barcode by applying a barcode classifier model to the barcode image, and decodes the item identifier from the barcode based on the binary sequence representation.
-
公开(公告)号:US20240003707A1
公开(公告)日:2024-01-04
申请号:US17873528
申请日:2022-07-26
Applicant: Maplebear Inc. (dba Instacart)
Inventor: Lin Gao , Yilin Huang , Shiyuan Yang , Xiaofei Zhou , Kaiyang Chu , Sikun Zhu
CPC classification number: G01C21/383 , G01C21/16 , G01S5/0036 , G07C5/04
Abstract: A shopping cart's tracking system receives wheel motion data from a plurality of wheel sensors coupled to a plurality of wheels of the shopping cart, wherein the wheel motion data describes rotation of the plurality of wheels and orientation of the plurality of wheels. The tracking system predicts an estimated location of the shopping cart by applying a machine-learning location model to the wheel motion data. The machine-learning location model is trained with training examples that are generated by: receiving prior wheel motion data from the plurality of wheel sensors, partitioning the prior wheel motion data into a plurality of segments using a time window, receiving one or more baseline locations at one or more prior timestamps, and generating one or more training examples, each training example comprising a segment of prior wheel motion data and a baseline location with a timestamp overlapping the segment.
-
公开(公告)号:US20250104040A1
公开(公告)日:2025-03-27
申请号:US18974543
申请日:2024-12-09
Applicant: Maplebear Inc.
Inventor: Yilin Huang , Ganglu Wu , Xiao Zhou , Youming Luo , Shiyuan Yang
Abstract: A smart shopping cart includes internally facing cameras and an integrated scale to identify objects that are placed in the cart. To avoid unnecessary processing of images that are irrelevant, and thereby save battery life, the cart uses the scale to detect when an object is placed in the cart. The cart obtains images from a cache and sends those to an object detection machine learning model. The cart captures and sends a load curve as input to the trained model for object detection. Labeled load data and labeled image data are used by a model training system to train the machine learning model to identify an item when it is added to the shopping cart. The shopping cart also uses weight data and the image data from a timeframe associated with the addition of the item to the cart as inputs.
-
-
-
-
-
-
-
-
-