公开(公告)号：US20250086685A1

公开(公告)日：2025-03-13

申请号：US18243600

申请日：2023-09-07

Applicant: Maplebear Inc.

Inventor： Shubhanshu Mishra ,  Gia Young ,  Jennie Morgan Burger ,  Joseph Olivier ,  Brent Luna ,  Yuanzheng Zhu ,  Mackenzie Cala ,  Armand Raquel-Santos ,  David Zandman ,  Mia Martinez Barnett ,  Callie Bleckner ,  Mohammad Abdul-Rahim

IPC: G06Q30/0601 ,  G06V20/50

Abstract: An online concierge system assists users in identifying additional information about items in an image. Image regions are identified in the image that may correspond to unknown items and an item search space is determined for detecting items in the image regions based on a context of the image, such as items in a warehouse or a list of items delivered to a customer. The identified items are used to retrieve relevant item information that is included in a prompt for a language model to extract relevant information for the item. As such, the process may automatically process the image into relevant textual information about the pictured items. Applications may be used to assist vision-impaired users in distinguishing delivered items or quickly identifying and evaluating relevant information about items.