公开(公告)号：US12013986B2

公开(公告)日：2024-06-18

申请号：US17838887

申请日：2022-06-13

Applicant: Purdue Research Foundation

Inventor： Ayan Sinha ,  Chiho Choi ,  Joon Hee Choi ,  Karthik Ramani

IPC: G06F3/01 ,  G06N20/00 ,  G06V10/44 ,  G06V20/64 ,  G06V30/194 ,  G06V40/10 ,  H04N13/271

CPC classification number: G06F3/017 ,  G06N20/00 ,  G06V10/454 ,  G06V20/653 ,  G06V30/194 ,  G06V40/11 ,  G06V40/113 ,  H04N13/271

Abstract: A method for hand pose identification in an automated system includes providing map data of a hand of a user to a first neural network trained to classify features corresponding to a joint angle of a wrist in the hand to generate a first plurality of activation features and performing a first search in a predetermined plurality of activation features stored in a database in the memory to identify a first plurality of hand pose parameters for the wrist associated with predetermined activation features in the database that are nearest neighbors to the first plurality of activation features. The method further includes generating a hand pose model corresponding to the hand of the user based on the first plurality of hand pose parameters and performing an operation in the automated system in response to input from the user based on the hand pose model.

公开(公告)号：US20240135831A1

公开(公告)日：2024-04-25

申请号：US18492156

申请日：2023-10-22

Applicant: Purdue Research Foundation

Inventor： Karthik Ramani ,  Jingyu Shi ,  Rahul Jain

IPC: G09B5/02 ,  G06F3/01 ,  G06T19/00 ,  G09B19/00

CPC classification number: G09B5/02 ,  G06F3/011 ,  G06T19/006 ,  G09B19/003 ,  G06T2200/24

Abstract: A learning system is disclosed that leverages intention-driven causality to enhance skill learning. The learning system enables an author to easily develop mixed reality (MR) tutorial content for performing a task that advantageously captures causal relationships between steps and, thus, enables such causality to be conveyed to the novice user when learning how to perform the task. To this end, the learning system leverages a novel hierarchical representation of causality and intention alongside a systematic workflow suitable for designing skill learning content. By preserving and presenting causal information to the novice user, the user can better understand not only the steps required to perform a task, but also why each step is performed.

公开(公告)号：US20240112424A1

公开(公告)日：2024-04-04

申请号：US18480158

申请日：2023-10-03

Applicant: Purdue Research Foundation

Inventor： Karthik Ramani ,  Zhengzhe Zhu ,  Ziyi Liu ,  Tianyi Wang

IPC: G06T19/00 ,  A63F13/577 ,  A63F13/63 ,  A63F13/655 ,  G06F3/0346 ,  G06F3/04815

CPC classification number: G06T19/006 ,  A63F13/577 ,  A63F13/63 ,  A63F13/655 ,  G06F3/0346 ,  G06F3/04815 ,  G06T2200/24 ,  G06T2210/21

Abstract: An augmented reality (AR) interaction authoring system is described. The AR interaction authoring system is configured to support the real-time creation of AR applications to support AR-enhanced toys. The design of the AR interaction authoring system enables bidirectional interactions between the physical-virtual space of toys and AR. The AR interaction authoring system allows intuitive authoring of AR animations and toys actuations through programming by demonstration, while referring to the physical toy for a contextual reference. Using a visual programming interface, users can create bidirectional interactions by utilizing users' input on toys to trigger AR animations and vice versa. A plug-and-play IoT toolkit is also disclosed that includes hardware to actuate common toys. In this way, users can effortlessly integrate toys into the virtual world in an impromptu design process, without lengthy electronic prototyping.

公开(公告)号：US11878421B2

公开(公告)日：2024-01-23

申请号：US17050309

申请日：2019-04-23

Applicant: Purdue Research Foundation

Inventor： Yuanzhi Cao ,  Karthik Ramani ,  Zhuangying Xu

IPC: B25J9/16 ,  G05D1/00 ,  B25J13/08 ,  B25J19/02 ,  G05D1/02 ,  G06F3/04847 ,  G06F3/0486

CPC classification number: B25J9/1661 ,  B25J9/1664 ,  B25J9/1689 ,  B25J13/089 ,  B25J19/023 ,  G05D1/0038 ,  G05D1/0044 ,  G05D1/0251 ,  G05D1/0274 ,  G06F3/0486 ,  G06F3/04847

Abstract: Disclosed is a visual and spatial programming system for robot navigation and robot-IoT task authoring. Programmable mobile robots serve as binding agents to link stationary IoT devices and perform collaborative tasks. Three key elements of robot task planning (human-robot-IoT) are coherently connected with one single smartphone device. Users can perform visual task authoring in an analogous manner to the real tasks that they would like the robot to perform with using an augmented reality interface. The mobile device mediates interactions between the user, robot(s), and IoT device-oriented tasks, guiding the path planning execution with Simultaneous Localization and Mapping (SLAM) to enable robust room-scale navigation and interactive task authoring.

公开(公告)号：US20230161447A1

公开(公告)日：2023-05-25

申请号：US18152021

申请日：2023-01-09

Applicant: Purdue Research Foundation

Inventor： Sang Ho Yoon ,  Karthik Ramani

IPC: G06F3/044 ,  G06F3/041

CPC classification number: G06F3/0447 ,  G06F3/0416 ,  G06F3/0443

Abstract: A sensing system includes a base material, a plurality of electrodes, a capacitive sensing channel and a controller. The stretchable base material has a resistance distribution that changes in response to being mechanically deformed as a result of a human body contact. The base material has a rebound elasticity. The electrodes are attached to a perimeter of the base material, the capacitive sensing channel is attached to the base material. The controller is operatively connected to the plurality of electrodes and the capacitive sensing channel. The controller is configured to measure instantaneous voltage measurements from the plurality of electrodes, and determine whether the base material is mechanically deformed based on the instantaneous voltage measurements using a support vector machine classifier.

公开(公告)号：US20230038709A1

公开(公告)日：2023-02-09

申请号：US17814965

申请日：2022-07-26

Applicant: Purdue Research Foundation

Inventor： Karthik Ramani ,  Tianyi Wang ,  Xun Qian ,  Fengming He

IPC: G06F3/01 ,  G06T19/00 ,  G06T13/20

Abstract: An augmented reality (AR) application authoring system is disclosed. The AR application authoring system enables the real-time creation of freehand interactive AR applications with freehand inputs. The AR application authoring system enables intuitive authoring of customized freehand gesture inputs through embodied demonstration while using the surrounding environment as a contextual reference. A visual programming interface is provided with which users can define freehand interactions by matching the freehand gestures with reactions of virtual AR assets. Thus, users can create personalized freehand interactions through simple trigger-action programming logic. Further, with the support of a real-time hand gesture detection algorithm, users can seamlessly test and iterate on the authored AR experience.

公开(公告)号：US11514642B2

公开(公告)日：2022-11-29

申请号：US16338881

申请日：2017-10-06

Applicant: PURDUE RESEARCH FOUNDATION

Inventor： Ayan Tuhinendu Sinha ,  Karthik Ramani

IPC: G06T17/00 ,  G06T15/10 ,  G06N3/08 ,  G06N3/04

Abstract: A method using a two-dimensional (2D) image representation of three-dimensional (3D) geometric objects in a machine learning framework has been developed. The method includes generating a single 2D geometry image corresponding to a 3D object model, and providing the single geometry image as input to a shape analysis task to enable shape analysis of the 3D object model based only on information encoded in the single 2D geometry image in the machine learning framework.

公开(公告)号：US11468650B2

公开(公告)日：2022-10-11

申请号：US17223287

申请日：2021-04-06

Applicant: Purdue Research Foundation

Inventor： Karthik Ramani ,  Terrell Kendall Glenn ,  Caleb Carithers ,  Ananya Ipsita

IPC: G06T19/00 ,  G06F8/34 ,  G06F3/04815 ,  G06T13/40

Abstract: A unique storytelling system is disclosed herein in which a plug-and-play hardware platform with an integrated augmented reality (AR) environment brings stories to life. The storytelling system includes an electronics toolkit and a structure toolkit which enable the user to prototype interactive physical devices for storytelling. The interactive physical devices crafted by the user are easily programmed using a simple visual programing environment of the storytelling system. Additionally, a story event planning tool of the storytelling system enables the user to create customized interactions between the interactive physical devices and virtual AR objects, such as virtual AR avatars or the like. Finally, an AR storytelling application of the storytelling system utilizes an AR device, such as a smartphone, to bring the interactive physical devices to life and enable the user to tell stories using the custom interactions that he or she created.

公开(公告)号：US20210406528A1

公开(公告)日：2021-12-30

申请号：US17363365

申请日：2021-06-30

Applicant: Purdue Research Foundation

Inventor： Karthik Ramani ,  Tianyi Wang ,  Xun Qian

IPC: G06K9/00 ,  G06T19/00 ,  G06F3/01 ,  G06T7/215 ,  G06T13/40

Abstract: A system and method for authoring and implementing context-aware applications (CAPs) are disclosed. The system and method enables users to record their daily activities and then build and deploy customized CAPs onto augmented reality platforms in which automated actions are performed in response to user-defined human actions. The system and method utilizes an integrated augmented reality platform composed of multiple camera systems, which allows for non-intrusive recording of end-users' activities and context detection while authoring and implementing CAPs. The system and method provides an augmented reality authoring interface for browsing, selecting, and editing recorded activities, and creating flexible CAPs through spatial interaction and visual programming.

公开(公告)号：US11199936B2

公开(公告)日：2021-12-14

申请号：US16544891

申请日：2019-08-19

Applicant: Purdue Research Foundation

Inventor： Sang Ho Yoon ,  Karthik Ramani

IPC: G06F3/044 ,  G06F3/041

Abstract: A single volume soft sensor capable of sensing real-time continuous contact and stretching. An electrical impedance tomography (EIT) technique with support vector machine (SVM) learning is employed to estimate changes of resistance distribution on the sensor caused by fingertip contact even during sensor deformation events. A deformation switch is incorporated to maintain the localization during deformation events.