-
公开(公告)号：US20230038709A1
公开(公告)日：2023-02-09
申请号：US17814965
申请日：2022-07-26
Applicant: Purdue Research Foundation
Inventor： Karthik Ramani , Tianyi Wang , Xun Qian , Fengming He
Abstract: An augmented reality (AR) application authoring system is disclosed. The AR application authoring system enables the real-time creation of freehand interactive AR applications with freehand inputs. The AR application authoring system enables intuitive authoring of customized freehand gesture inputs through embodied demonstration while using the surrounding environment as a contextual reference. A visual programming interface is provided with which users can define freehand interactions by matching the freehand gestures with reactions of virtual AR assets. Thus, users can create personalized freehand interactions through simple trigger-action programming logic. Further, with the support of a real-time hand gesture detection algorithm, users can seamlessly test and iterate on the authored AR experience.
-
公开(公告)号：US20210134065A1
公开(公告)日：2021-05-06
申请号：US17085620
申请日：2020-10-30
Applicant: Purdue Research Foundation
Inventor： Karthik Ramani , Subramaniam Chidambaram , Hank Huang , Fengming He
Abstract: A method of operating an augmented reality (AR) system includes capturing images of a first real-world workspace using a camera of a first head mounted AR device of the AR system being worn by a first user, processing the images using a first processor of the AR system to identify physical objects in the first real-world workspace and detect 3D positions of the identified physical objects in a 3D space corresponding to the first real-world workspace, rendering virtual objects representing the identified physical objects on the display of the first head mounted AR device at the respective 3D positions for the identified physical objects, manipulating a first one of the virtual objects using at least one hand-held controller of the AR system in a manner that mimics a performance of a first procedural task using the physical object associated with the first one of the virtual objects, recording the manipulation of the first one of the virtual objects that mimics the performance of the first procedural task as first augmented reality content, and storing the first augmented reality content in a memory of the AR system.
-
3.发明公开公开(公告)号：US20240118786A1
公开(公告)日：2024-04-11
申请号：US18480134
申请日：2023-10-03
Applicant: Purdue Research Foundation
Inventor： Karthik Ramani , Xun Qian , Tianyi Wang , Fengming He
IPC: G06F3/04815 , G06F3/01 , G06F3/04842 , G06F3/04845 , G06T7/194 , G06T7/73
CPC classification number: G06F3/04815 , G06F3/011 , G06F3/017 , G06F3/04842 , G06F3/04845 , G06T7/194 , G06T7/74 , G06T2207/20081 , G06T2207/30196
Abstract: A method and system for hand-object interaction dataset collection is described herein, which is configured to support user-specified collection of hand-object interaction datasets. Such hand-object interaction datasets are useful, for example, for training 3D hand and object pose estimation model. The method and system adopt a sequential process of first recording hand and object pose labels by manipulating a virtual bounding box, rather than a physical object. Naturally, hand-object occlusions do not occur during the manipulation of the virtual bounding box, so these labels are provided with high accuracy. Subsequently, the images are separately captured of the hand-object interaction with the physical object. These images are paired with the previously recorded hand and object pose labels.
-
Patent Agency Ranking
公开(公告)号：US12153737B2
公开(公告)日：2024-11-26
申请号：US17814965
申请日：2022-07-26
Applicant: Purdue Research Foundation
Inventor： Karthik Ramani , Tianyi Wang , Xun Qian , Fengming He
Abstract: An augmented reality (AR) application authoring system is disclosed. The AR application authoring system enables the real-time creation of freehand interactive AR applications with freehand inputs. The AR application authoring system enables intuitive authoring of customized freehand gesture inputs through embodied demonstration while using the surrounding environment as a contextual reference. A visual programming interface is provided with which users can define freehand interactions by matching the freehand gestures with reactions of virtual AR assets. Thus, users can create personalized freehand interactions through simple trigger-action programming logic. Further, with the support of a real-time hand gesture detection algorithm, users can seamlessly test and iterate on the authored AR experience.
-
公开(公告)号：US20240312154A1
公开(公告)日：2024-09-19
申请号：US18584258
申请日：2024-02-22
Applicant: Purdue Research Foundation
Inventor： Karthik Ramani , Fengming He , Xun Qian , Jingyu Shi , Xiyun Hu
CPC classification number: G06T19/006 , G06T13/20 , G06T19/20 , G06V40/28 , G06T2219/2004 , G06T2219/2012 , G06T2219/2016 , G06T2219/2021 , G06V2201/07
Abstract: An Tangible User Interface (TUI) authoring system is disclosed that allows end-users to customize edges on daily objects as TUI inputs to control varied digital functions. The TUI application authoring system incorporates an integrated AR-device and an integrated vision-based detection pipeline that can track 3D edges and detect the touch interaction between fingers and edges. Leveraging the spatial-awareness of AR, users can simply select an edge by sliding fingers along it and then make the edge interactive by connecting it to various digital functions. The system is demonstrated using four exemplary use cases including multi-function controllers, smart homes, games, and TUI-based tutorials.
-
公开(公告)号：US11810259B2
公开(公告)日：2023-11-07
申请号：US17810767
申请日：2022-07-05
Applicant: Purdue Research Foundation
Inventor： Karthik Ramani , Subramaniam Chidambaram , Hank Huang , Fengming He
CPC classification number: G06T19/006 , G02B27/0172 , G06T7/251 , G06T19/003 , G02B2027/0138
Abstract: A method of operating an augmented reality (AR) system includes capturing images of a first real-world workspace using a camera of a first head mounted AR device of the AR system being worn by a first user, processing the images using a first processor of the AR system to identify physical objects in the first real-world workspace and detect 3D positions of the identified physical objects in a 3D space corresponding to the first real-world workspace, rendering virtual objects representing the identified physical objects on the display of the first head mounted AR device at the respective 3D positions for the identified physical objects, manipulating a first one of the virtual objects using at least one hand-held controller of the AR system in a manner that mimics a performance of a first procedural task using the physical object associated with the first one of the virtual objects, recording the manipulation of the first one of the virtual objects that mimics the performance of the first procedural task as first augmented reality content, and storing the first augmented reality content in a memory of the AR system.
-
公开(公告)号：US20220414992A1
公开(公告)日：2022-12-29
申请号：US17810767
申请日：2022-07-05
Applicant: Purdue Research Foundation
Inventor： Karthik Ramani , Subramaniam Chidambaram , Hank Huang , Fengming He
Abstract: A method of operating an augmented reality (AR) system includes capturing images of a first real-world workspace using a camera of a first head mounted AR device of the AR system being worn by a first user, processing the images using a first processor of the AR system to identify physical objects in the first real-world workspace and detect 3D positions of the identified physical objects in a 3D space corresponding to the first real-world workspace, rendering virtual objects representing the identified physical objects on the display of the first head mounted AR device at the respective 3D positions for the identified physical objects, manipulating a first one of the virtual objects using at least one hand-held controller of the AR system in a manner that mimics a performance of a first procedural task using the physical object associated with the first one of the virtual objects, recording the manipulation of the first one of the virtual objects that mimics the performance of the first procedural task as first augmented reality content, and storing the first augmented reality content in a memory of the AR system.
-
公开(公告)号：US11380069B2
公开(公告)日：2022-07-05
申请号：US17085620
申请日：2020-10-30
Applicant: Purdue Research Foundation
Inventor： Karthik Ramani , Subramaniam Chidambaram , Hank Huang , Fengming He
Abstract: A method of operating an augmented reality (AR) system includes capturing images of a first real-world workspace using a camera of a first head mounted AR device of the AR system being worn by a first user, processing the images using a first processor of the AR system to identify physical objects in the first real-world workspace and detect 3D positions of the identified physical objects in a 3D space corresponding to the first real-world workspace, rendering virtual objects representing the identified physical objects on the display of the first head mounted AR device at the respective 3D positions for the identified physical objects, manipulating a first one of the virtual objects using at least one hand-held controller of the AR system in a manner that mimics a performance of a first procedural task using the physical object associated with the first one of the virtual objects, recording the manipulation of the first one of the virtual objects that mimics the performance of the first procedural task as first augmented reality content, and storing the first augmented reality content in a memory of the AR system.
-
-
-
-
-
-
-
Search Results
8
records
(took 0.018 seconds)
