公开(公告)号：US20240005662A1

公开(公告)日：2024-01-04

申请号：US18345845

申请日：2023-06-30

Applicant: Verb Surgical Inc.

Inventor： Bokai ZHANG ,  Darrick STURGEON ,  Arjun SHANKAR ,  Varun GOEL ,  Jocelyn BARKER

IPC: G06V20/40 ,  G06V10/77 ,  G06V10/82

CPC classification number: G06V20/46 ,  G06V10/7715 ,  G06V10/82 ,  G06V2201/034

Abstract: A machine learning model has two stages. In a first stage, features from one or more frames of a surgical video are extracted, wherein the features include presence of a surgical instrument and type of the surgical instrument. A second stage analyzes the surgical video based on the extracted features to recognize a video segment, wherein the recognized video segment includes a detected presence of the surgical instrument, and where the video segment is recognized by a multi-stage temporal convolution network (MS-TCN) or a vision transformer. Other aspects are also described and claimed.