Training a model to identify items based on image data and load curve data

    公开(公告)号:US12205098B2

    公开(公告)日:2025-01-21

    申请号:US17874956

    申请日:2022-07-27

    Applicant: Maplebear Inc.

    Abstract: A smart shopping cart includes internally facing cameras and an integrated scale to identify objects that are placed in the cart. To avoid unnecessary processing of images that are irrelevant, and thereby save battery life, the cart uses the scale to detect when an object is placed in the cart. The cart obtains images from a cache and sends those to an object detection machine learning model. The cart captures and sends a load curve as input to the trained model for object detection. Labeled load data and labeled image data are used by a model training system to train the machine learning model to identify an item when it is added to the shopping cart. The shopping cart also uses weight data and the image data from a timeframe associated with the addition of the item to the cart as inputs.

    Subregion transformation for label decoding by an automated checkout system

    公开(公告)号:US12299529B2

    公开(公告)日:2025-05-13

    申请号:US18587719

    申请日:2024-02-26

    Applicant: Maplebear Inc.

    Abstract: An automated checkout system modifies received images of machine-readable labels to improve the performance of a label detection model that the system uses to decode item identifiers encoded in the machine-readable labels. For example, the automated checkout system may transform subregions of an image of a machine-readable label to adjust for distortions in the image's depiction of the machine-readable label. Similarly, the automated checkout system may identify readable regions within received images of machine-readable labels and apply a label detection model to those readable regions. By modifying received images of machine-readable labels, these techniques improve on existing computer-vision technologies by allowing for the effective decoding of machine-readable labels based on real-world images using relatively clean training data.

    TRAINING A MODEL TO IDENTIFY ITEMS BASED ON IMAGE DATA AND LOAD CURVE DATA

    公开(公告)号:US20250104040A1

    公开(公告)日:2025-03-27

    申请号:US18974543

    申请日:2024-12-09

    Applicant: Maplebear Inc.

    Abstract: A smart shopping cart includes internally facing cameras and an integrated scale to identify objects that are placed in the cart. To avoid unnecessary processing of images that are irrelevant, and thereby save battery life, the cart uses the scale to detect when an object is placed in the cart. The cart obtains images from a cache and sends those to an object detection machine learning model. The cart captures and sends a load curve as input to the trained model for object detection. Labeled load data and labeled image data are used by a model training system to train the machine learning model to identify an item when it is added to the shopping cart. The shopping cart also uses weight data and the image data from a timeframe associated with the addition of the item to the cart as inputs.

Patent Agency Ranking