公开(公告)号：US20250133037A1

公开(公告)日：2025-04-24

申请号：US18920765

申请日：2024-10-18

Applicant: Maplebear Inc.

Inventor： Jacob Jensen ,  Shubhanshu Mishra ,  Aomin Wu ,  Rajpal Paryani ,  Guanghua Shu ,  Sicheng Zhou

IPC: H04L51/02

Abstract: A system may smartly edit the context of a conversation to be input into a chatbot LLM by using a conversation compression algorithm to prune and compress redundant elements. The system evaluates the conversation context compression algorithm using both a chatbot LLM and an adversarial LLM. The system retrieves a logged conversation and generates a compressed conversation context from the logged conversation. The system generates a synthetic user response by applying the adversarial LLM and generates a test conversation by replacing a user response in the conversation with the synthetic user response. The system generates a compressed context of the test conversation. The system generates a test chatbot LLM response by prompting the chatbot LLM with the compressed context of the test conversation. The system evaluates the conversation context compression algorithm by comparing the test chatbot response with a benchmark chatbot response.