公开(公告)号：US11521373B1

公开(公告)日：2022-12-06

申请号：US17827975

申请日：2022-05-30

Applicant: Bertec Corporation

Inventor： Emre Akbas ,  Batuhan Karagoz ,  Necip Berme ,  Mohan Chandra Baro

IPC: G06K9/00 ,  G06V10/82 ,  G06V40/10 ,  G06V10/75 ,  G06T7/73

Abstract: A system for estimating a three dimensional pose of one or more persons in a scene is disclosed herein. The system includes one or more cameras and a data processor configured to execute computer executable instructions. The computer executable instructions include: (i) receiving one or more images of the scene from the one or more cameras; (ii) extracting features from the one or more images of the scene for providing inputs to a first branch pose estimation neural network and second branch pose estimation neural network; (iii) generating a first training signal from the second branch pose estimation neural network using a three dimensional reconstruction module for input into the first branch pose estimation neural network; (iv) generating one or more volumetric heatmaps; and (v) applying a maximization function to the one or more volumetric heatmaps to obtain a 3D pose of one or more persons in the scene.

公开(公告)号：US12205311B1

公开(公告)日：2025-01-21

申请号：US18382838

申请日：2023-10-23

Applicant: Bertec Corporation

Inventor： Batuhan Karagoz ,  Emre Akbas ,  Bedirhan Uguz ,  Ozhan Suat ,  Necip Berme ,  Mohan Chandra Baro

IPC: G06T7/50 ,  G06V10/75 ,  G06V20/40

Abstract: A system for training neural networks that predict the parameters of a human mesh model is disclosed herein. The system includes at least one camera and a data processor configured to execute computer executable instructions for: receiving a first frame and a second frame of a video from the at least one camera; extracting first and second image data from the first and second frames of the video; inputting the sequence of frames of the video into a human mesh estimator module, the human mesh estimator module estimating mesh parameters from the sequence of frames of the video so as to determine a predicted mesh; and generating a training signal for input into the human mesh estimator module by using a two-dimensional keypoint loss module that compares a first set of two-dimensional image-based keypoints to a second set of two-dimensional model-based keypoints.

公开(公告)号：US11631193B1

公开(公告)日：2023-04-18

申请号：US17734492

申请日：2022-05-02

Applicant: Bertec Corporation

Inventor： Emre Akbas ,  Batuhan Karagoz ,  Bedirhan Uguz ,  Ozhan Suat ,  Necip Berme ,  Mohan Chandra Baro

IPC: G06T7/73 ,  G06K9/62 ,  G06N3/04 ,  G06V10/40 ,  G06V40/10 ,  G06V10/82 ,  H04N5/247

Abstract: A system for estimating a pose of one or more persons in a scene includes a camera configured to capture one or more images of the scene; and a data processor configured to execute computer executable instructions for: (i) receiving the one or more images of the scene from the camera; (ii) extracting features from the one or more images of the scene for providing inputs to a keypoint subnet and a person detection subnet; (iii) generating one or more keypoints using the keypoint subnet; (iv) generating one or more person instances using the person detection subnet; (v) assigning the one or more keypoints to the one or more person instances by learning pose structures from image data; and (vi) determining one or more poses of the one or more persons in the scene using the assignment of the one or more keypoints to the one or more person instances.

公开(公告)号：US11182924B1

公开(公告)日：2021-11-23

申请号：US17107845

申请日：2020-11-30

Applicant: Bertec Corporation

Inventor： Emre Akbas ,  Batuhan Karagoz ,  Necip Berme ,  Cameron Scott Hobson ,  Mohan Chandra Baro

IPC: G06K9/00 ,  G06T7/73 ,  G08B7/06 ,  A61B5/01 ,  A61B5/00 ,  A61B5/11 ,  G06N3/08 ,  G09B19/00 ,  G06T7/246

Abstract: A system for estimating a three dimensional pose and determining one or more biomechanical performance parameters of at least one person in a scene is disclosed herein. The system includes at least one camera and at least one measurement assembly, the at least one camera configured to capture an image of the scene; and a data processor including at least one hardware component, the data processor configured to execute computer executable instructions. The computer executable instructions comprising instructions for: (i) receiving the image of the scene from the at least one camera; (ii) extracting features from the image of the scene for providing inputs to a convolutional neural network; (iii) generating one or more volumetric heatmaps using the convolutional neural network; and (iv) applying a maximization function to the one or more volumetric heatmaps to obtain a three dimensional pose of the at least one person in the scene.

公开(公告)号：US10853970B1

公开(公告)日：2020-12-01

申请号：US16826200

申请日：2020-03-21

Applicant: Bertec Corporation

Inventor： Emre Akbas ,  Muhammed Kocabas ,  Muhammed Salih Karagoz ,  Necip Berme

IPC: G06K9/00 ,  G06T7/73 ,  G06T1/00 ,  G06T1/20

Abstract: A system for estimating a three dimensional pose of one or more persons in a scene is disclosed herein. The system includes at least one camera, the at least one camera configured to capture an image of the scene; and a data processor including at least one hardware component, the data processor configured to execute computer executable instructions. The computer executable instructions comprising instructions for: (i) receiving the image of the scene from the at least one camera; (ii) extracting features from the image of the scene for providing inputs to a convolutional neural network; (iii) generating one or more volumetric heatmaps using the convolutional neural network; and (iv) applying a maximization function to the one or more volumetric heatmaps to obtain a three dimensional pose of one or more persons in the scene.

公开(公告)号：US11798182B1

公开(公告)日：2023-10-24

申请号：US18195777

申请日：2023-05-10

Applicant: Bertec Corporation

Inventor： Batuhan Karagoz ,  Emre Akbas ,  Bedirhan Uguz ,  Ozhan Suat ,  Necip Berme ,  Mohan Chandra Baro

IPC: G06K9/00 ,  G06T7/50 ,  G06V10/75 ,  G06V20/40

CPC classification number: G06T7/50 ,  G06V10/751 ,  G06V20/46 ,  G06T2207/20081 ,  G06T2207/20084 ,  G06T2207/30201

Abstract: A system for training neural networks that predict the parameters of a human mesh model is disclosed herein. The system includes at least one camera and a data processor configured to execute computer executable instructions for: receiving a first frame and a second frame of a video from the at least one camera; extracting first and second features from the first and second frames of the video; inputting the sequence of frames of the video into a human mesh estimator module, the human mesh estimator module estimating mesh parameters from the sequence of frames of the video so as to determine a predicted mesh; and generating a training signal for input into the human mesh estimator module by using at least one of: (i) a depth loss module and (ii) a rigid transform loss module.

公开(公告)号：US11348279B1

公开(公告)日：2022-05-31

申请号：US17533096

申请日：2021-11-22

Applicant: Bertec Corporation

Inventor： Emre Akbas ,  Batuhan Karagoz ,  Bedirhan Uguz ,  Ozhan Suat ,  Necip Berme ,  Mohan Chandra Baro

IPC: G06K9/00 ,  G06T7/73 ,  G06T7/50 ,  G06N3/04

Abstract: A system for estimating a three dimensional pose of one or more persons in a scene is disclosed herein. The system includes at least one camera, the at least one camera configured to capture an image of the scene; and a data processor including at least one hardware component, the data processor configured to execute computer executable instructions. The computer executable instructions comprising instructions for: (i) receiving the image of the scene from the at least one camera; (ii) extracting features from the image of the scene for providing inputs to a convolutional neural network; (iii) generating one or more volumetric heatmaps using the convolutional neural network; and (iv) applying a maximization function to the one or more volumetric heatmaps to obtain a three dimensional pose of one or more persons in the scene.

公开(公告)号：US11321868B1

公开(公告)日：2022-05-03

申请号：US17443416

申请日：2021-07-26

Applicant: Bertec Corporation

Inventor： Emre Akbas ,  Muhammed Kocabas ,  Muhammed Salih Karagoz ,  Necip Berme

IPC: G06T7/73 ,  G06K9/00 ,  G06K9/46 ,  G06K9/62 ,  G06N3/04 ,  H04N5/247

Abstract: A system for estimating a pose of one or more persons in a scene includes a camera configured to capture an image of the scene; and a data processor configured to execute computer executable instructions for: (i) receiving the image of the scene from the camera; (ii) extracting features from the image of the scene for providing inputs to a keypoint subnet and a person detection subnet; (iii) generating one or more keypoints using the keypoint subnet; (iv) generating one or more person instances using the person detection subnet; (v) assigning the one or more keypoints to the one or more person instances by learning pose structures from the image data; and (vi) determining one or more poses of the one or more persons in the scene using the assignment of the one or more keypoints to the one or more person instances.

公开(公告)号：US12094159B1

公开(公告)日：2024-09-17

申请号：US18135399

申请日：2023-04-17

Applicant: Bertec Corporation

Inventor： Emre Akbas ,  Utku Aktas ,  Bedirhan Uguz ,  Ozhan Suat ,  Necip Berme ,  Mohan Chandra Baro

IPC: G06T7/73 ,  G06F18/21 ,  G06N3/045 ,  G06V10/44 ,  G06V10/764 ,  G06V10/82 ,  G06V40/10 ,  G06V40/20 ,  H04N23/90

CPC classification number: G06T7/73 ,  G06F18/21 ,  G06N3/045 ,  G06V10/454 ,  G06V10/764 ,  G06V10/82 ,  G06V40/10 ,  G06V40/20 ,  G06T2207/20016 ,  G06T2207/20084 ,  G06T2207/20132 ,  G06T2207/30196 ,  G06V2201/07 ,  H04N23/90

Abstract: A system for estimating a pose of one or more persons in a scene includes a camera configured to capture one or more images of the scene; and a data processor configured to execute computer executable instructions for: (i) receiving the one or more images of the scene from the camera; (ii) extracting features from the one or more images of the scene for providing inputs to a keypoint subnet and a person detection subnet; (iii) generating one or more keypoints using the keypoint subnet; (iv) generating one or more person instances using the person detection subnet; (v) assigning the one or more keypoints to the one or more person instances by learning pose structures from image data; and (vi) determining one or more poses of the one or more persons in the scene using the assignment of the one or more keypoints to the one or more person instances.

公开(公告)号：US11688139B1

公开(公告)日：2023-06-27

申请号：US18074978

申请日：2022-12-05

Applicant: Bertec Corporation

Inventor： Batuhan Karagoz ,  Emre Akbas ,  Necip Berme ,  Mohan Chandra Baro

IPC: G06K9/00 ,  G06T19/00 ,  G06T7/73 ,  G06T15/10

CPC classification number: G06T19/00 ,  G06T7/73 ,  G06T15/10 ,  G06T2200/08 ,  G06T2207/20081 ,  G06T2207/20084 ,  G06T2207/30196 ,  G06T2219/004

Abstract: A system for estimating a three dimensional pose of one or more persons in a scene is disclosed herein. The system includes one or more cameras and a data processor configured to execute computer executable instructions. The computer executable instructions include: (i) receiving one or more images of the scene from the one or more cameras; (ii) extracting features from the one or more images of the scene for providing inputs to a first branch pose estimation neural network and a second branch pose estimation neural network; (iii) generating, by using a three dimensional reconstruction module, three dimensional reconstructions from two dimensional pose estimates produced by the second branch pose estimation neural network; and (iv) projecting, by using a reprojection module, the three dimensional reconstructions to camera image planes of respective image samples, and uploading the reprojections and image samples to an annotation server.