公开(公告)号：US20160351068A1

公开(公告)日：2016-12-01

申请号：US15117948

申请日：2014-12-03

Applicant: SOUTH CHINA UNIVERSITY OF TECHNOLOGY

Inventor： Wang XU ,  Xiangmin XU ,  Xiaofen XING

IPC: G09B17/00 ,  G06F3/16 ,  G06F3/01 ,  G10L13/04 ,  G06K9/20 ,  G06T7/00 ,  G06T7/40 ,  G09B19/06 ,  G06K9/00

CPC classification number: G09B17/006 ,  G06F3/017 ,  G06F3/167 ,  G06K9/00355 ,  G06K9/2081 ,  G06T2207/10024 ,  G06T2207/20104 ,  G06T2207/20112 ,  G06T2207/30196 ,  G09B5/062 ,  G09B19/06 ,  G10L13/00 ,  G10L13/04 ,  G10L15/22

Abstract: A finger reading method and device based on visual gestures. A user makes a circle on a required finger reading region on a book by using a finger; a camera captures the circle making action of the finger, and an image processing module acquires the position a fingertip according to a profile analysis algorithm, acquires the endpoints of the track edge in upper, lower, left and right directions, and fits a rectangle according to the upper, lower, left and right end points in order to identify content such as characters or graphs of rectangular region content. A voice synthesis technology is performed. Voice information is fed to the user to realize a finger reading functions. The device can be worn on the head of the user, and includes camera and bone conduction earphones arranged on both sides thereof.

Abstract translation: 基于视觉手势的手指读取方法和装置。 用户通过手指在书上的所需手指读取区域上形成一个圆圈; 相机拍摄手指的圆圈动作，并且图像处理模块根据轮廓分析算法获取指尖的位置，获取上，下，左，右方向上的轨迹边缘的端点，并且根据 到上，下，左和右端点，以便识别诸如矩形区域内容的字符或图形的内容。 进行语音合成技术。 语音信息被馈送给用户以实现手指读取功能。 该装置可以佩戴在使用者的头部，并且包括布置在其两侧的相机和骨传导耳机。