公开(公告)号：US12197998B2

公开(公告)日：2025-01-14

申请号：US18398739

申请日：2023-12-28

Applicant: Maplebear Inc.

Inventor： Shiyuan Yang ,  Yilin Huang ,  Wentao Pan ,  Xiao Zhou

IPC: G06K7/14 ,  G06T7/10

Abstract: A barcode decoding system decodes item identifiers from images of barcodes. The barcode decoding system receives an image of a barcode and rotates the image to a pre-determined orientation. The barcode decoding system also may segment the barcode image to emphasize the portions of the image that correspond to the barcode. The barcode decoding system generates a binary sequence representation of the item identifier encoded in the barcode by applying a barcode classifier model to the barcode image, and decodes the item identifier from the barcode based on the binary sequence representation.

公开(公告)号：US20240144789A1

公开(公告)日：2024-05-02

申请号：US18408893

申请日：2024-01-10

Applicant: Maplebear Inc.

Inventor： Lin Gao ,  Shiyuan Yang

IPC: G07G1/14 ,  A47F9/04 ,  G01G19/415 ,  G01G21/22 ,  G06Q20/20 ,  G06V20/40 ,  G07G1/00

CPC classification number: G07G1/14 ,  A47F9/048 ,  G01G19/415 ,  G01G21/22 ,  G06Q20/208 ,  G06V20/44 ,  G07G1/0072 ,  G06V20/52

Abstract: Disclosed are visual recognition and sensor fusion weight detection system and method. An example method includes: tracking, by a sensor system, objects and motions within a selected area of a store; activating, by the sensor system, a first computing device positioned in the selected area in response to detecting a presence of a customer within the selected area: identifying, by the sensor system, the customer and at least one item carried by the customer; transmitting, by the sensor system, identifying information of the customer and the at least one item to a computing server system via a communication network; measuring, by the first computing device, a weight of the at least one item; transmitting, by the first computing device, the weight to the computing server system via the communication network; and generating, by the computing server system, via the communication network, transaction information of the at least one item.

公开(公告)号：US20240135123A1

公开(公告)日：2024-04-25

申请号：US18398739

申请日：2023-12-28

Applicant: Maplebear Inc.

Inventor： Shiyuan Yang ,  Yilin Huang ,  Wentao Pan ,  Xiao Zhou

IPC: G06K7/14 ,  G06T7/10

CPC classification number: G06K7/1413 ,  G06T7/10 ,  G06F2218/12 ,  G06T2207/20081

Abstract: A barcode decoding system decodes item identifiers from images of barcodes. The barcode decoding system receives an image of a barcode and rotates the image to a pre-determined orientation. The barcode decoding system also may segment the barcode image to emphasize the portions of the image that correspond to the barcode. The barcode decoding system generates a binary sequence representation of the item identifier encoded in the barcode by applying a barcode classifier model to the barcode image, and decodes the item identifier from the barcode based on the binary sequence representation.

公开(公告)号：US20240003707A1

公开(公告)日：2024-01-04

申请号：US17873528

申请日：2022-07-26

Applicant: Maplebear Inc. (dba Instacart)

Inventor： Lin Gao ,  Yilin Huang ,  Shiyuan Yang ,  Xiaofei Zhou ,  Kaiyang Chu ,  Sikun Zhu

IPC: G01C21/00 ,  G07C5/04 ,  G01S5/00 ,  G01C21/16

CPC classification number: G01C21/383 ,  G01C21/16 ,  G01S5/0036 ,  G07C5/04

Abstract: A shopping cart's tracking system receives wheel motion data from a plurality of wheel sensors coupled to a plurality of wheels of the shopping cart, wherein the wheel motion data describes rotation of the plurality of wheels and orientation of the plurality of wheels. The tracking system predicts an estimated location of the shopping cart by applying a machine-learning location model to the wheel motion data. The machine-learning location model is trained with training examples that are generated by: receiving prior wheel motion data from the plurality of wheel sensors, partitioning the prior wheel motion data into a plurality of segments using a time window, receiving one or more baseline locations at one or more prior timestamps, and generating one or more training examples, each training example comprising a segment of prior wheel motion data and a baseline location with a timestamp overlapping the segment.

公开(公告)号：US20220343660A1

公开(公告)日：2022-10-27

申请号：US17726385

申请日：2022-04-21

Applicant: Maplebear Inc. (dba Instacart)

Inventor： Shiyuan Yang ,  Shray Chandra

IPC: G06V20/64 ,  G06T7/10 ,  G07G1/00

Abstract: An item recognition system uses a top camera and one or more peripheral cameras to identify items. The item recognition system may use image embeddings generated based on images captured by the cameras to generate a concatenated embedding that describes an item depicted in the image. The item recognition system may compare the concatenated embedding to reference embeddings to identify the item. Furthermore, the item recognition system may detect when items are overlapping in an image. For example, the item recognition system may apply an overlap detection model to a top image and a pixel-wise mask for the top image to detect whether an item is overlapping with another in the top image. The item recognition system notifies a user of the overlap if detected.