Invention Grant
- Patent Title: Dual hand detection in teaching from demonstration
-
Application No.: US17018674Application Date: 2020-09-11
-
Publication No.: US11712797B2Publication Date: 2023-08-01
- Inventor: Kaimeng Wang , Tetsuaki Kato
- Applicant: FANUC CORPORATION
- Applicant Address: JP Yamanashi
- Assignee: FANUC CORPORATION
- Current Assignee: FANUC CORPORATION
- Current Assignee Address: JP Yamanashi
- Agency: Shumaker, Loop & Kendrick LLP
- Agent John A. Miller
- Main IPC: G06K9/62
- IPC: G06K9/62 ; B25J9/00 ; B25J9/16 ; B25J13/08 ; G06T7/73 ; B25J19/02

Abstract:
A method for dual hand detection in robot teaching from human demonstration. A camera image of the demonstrator's hands and workpieces is provided to a first neural network which determines the identity of the left and right hand of the human demonstrator from the image, and also provides cropped sub-images of the identified hands. The first neural network is trained using images in which the left and right hands are pre-identified. The cropped sub-images are then provided to a second neural network which detects the pose of both the left and right hand from the images, where the sub-image for the left hand is horizontally flipped before and after the hand pose detection if second neural network is trained with right hand images. The hand pose data is converted to robot gripper pose data and used for teaching a robot to perform an operation through human demonstration.
Public/Granted literature
- US20220080580A1 DUAL HAND DETECTION IN TEACHING FROM DEMONSTRATION Public/Granted day:2022-03-17
Information query