公开(公告)号：US09571789B2

公开(公告)日：2017-02-14

申请号：US14747839

申请日：2015-06-23

Applicant: INTOUCH TECHNOLOGIES, INC.

Inventor： Marco Pinter ,  Charles S. Jordan ,  Daniel Sanchez ,  Kevin Hanrahan ,  Kelton Temby ,  Christopher Lambrecht

IPC: H04N7/14 ,  G06F19/00 ,  H04N7/18

CPC classification number: H04N7/147 ,  G06F19/00 ,  G06F19/3418 ,  G11B27/005 ,  G11B27/036 ,  G11B27/102 ,  G11B27/34 ,  H04N5/272 ,  H04N5/77 ,  H04N7/142 ,  H04N7/181 ,  H04N7/183 ,  H04N7/185

Abstract: A telepresence device may relay video, audio, and/or measurement data to a user operating a control device. A user interface may permit the user to quickly view and/or understand temporally and/or spatially disparate information. The telepresence device may pre-gather looped video of spatially disparate areas in an environment. A temporal control mechanism may start video playback at a desired point in a current or historical video segment. Notations may be associated with time spans in a video and recalled by capturing an image similar to a frame in the time span of the video. An area of interest may be selected and video containing the area of interest may be automatically found. Situational data may be recorded and used to recall video segments of interest. The telepresence device may synchronize video playback and movement. A series of videos may be recorded at predetermined time intervals to capture visually trending information.

Abstract translation: 远程呈现设备可以将视频，音频和/或测量数据中继到操作控制设备的用户。 用户界面可以允许用户快速查看和/或理解时间上和/或空间上不同的信息。 远程呈现设备可以在环境中预先收集空间上不同区域的循环视频。 时间控制机制可以在当前或历史视频段中的期望点开始视频回放。 记录可能与视频中的时间跨度相关联，并且通过在视频的时间间隔中捕获类似于帧的图像而被调用。 可以选择感兴趣的区域，并且可以自动找到包含感兴趣区域的视频。 情境数据可以被记录并用于召回感兴趣的视频段。 远程呈现设备可以同步视频播放和移动。 可以以预定的时间间隔记录一系列视频以捕获视觉上的趋势信息。

公开(公告)号：US20160283685A1

公开(公告)日：2016-09-29

申请号：US15154518

申请日：2016-05-13

Applicant: InTouch Technologies, Inc. ,  iRobot Corporation

Inventor： Charles S. Jordan ,  Andy Young ,  Mei Sheng Ng ,  Yair Lurie ,  Fuji Lai ,  Timothy C. Wright ,  Cody Herzog ,  Blair Whitney ,  Bill Rizzi ,  James Ballantyne ,  Yulun Wang ,  Cheuk Wah Wong ,  Justin Kearns ,  Orjeta Taka ,  Ramchandra Karandikar

IPC: G06F19/00 ,  H04N7/14 ,  G06Q10/10 ,  G06F3/0484 ,  G06F3/0488

CPC classification number: G16H40/63 ,  G06F3/04847 ,  G06F3/04883 ,  G06F19/00 ,  G06F19/3418 ,  G06Q10/10 ,  G06Q50/22 ,  H04N7/142 ,  H04N7/147

Abstract: The present disclosure describes various aspects of remote presence interfaces (RPIs) for use on portable electronic devices (PEDs) to interface with remote telepresence devices. An RPI may allow a user to interact with a telepresence device, view a live video feed, provide navigational instructions, and/or otherwise interact with the telepresence device. The RPI may allow a user to manually, semi-autonomously, or autonomously control the movement of the telepresence device. One or more panels associated with a video feed, patient data, calendars, date, time, telemetry data, PED data, telepresence device data, healthcare facility information, healthcare practitioner information, menu tabs, settings controls, and/or other features may be utilized via the RPI.

公开(公告)号：US09381654B2

公开(公告)日：2016-07-05

申请号：US13894246

申请日：2013-05-14

Applicant: INTOUCH TECHNOLOGIES, INC.

Inventor： John Cody Herzog ,  Blair Whitney ,  Yulun Wang ,  Charles S. Jordan ,  Marco Pinter

IPC: G05B19/00 ,  B25J19/02 ,  B25J5/00 ,  B25J9/16

CPC classification number: B25J9/1689 ,  B25J5/00 ,  B25J5/007 ,  B25J19/023 ,  G05B2219/40153 ,  G05B2219/40178 ,  G05B2219/40195 ,  G05D1/0038 ,  G05D1/0246 ,  G05D2201/0206 ,  Y10S901/01 ,  Y10S901/47

Abstract: A robot system with a robot that has a camera and a remote control station that can connect to the robot. The connection can include a plurality of privileges. The system further includes a server that controls which privileges are provided to the remote control station. The privileges may include the ability to control the robot, joint in a multi-cast session and the reception of audio/video from the robot. The privileges can be established and edited through a manager control station. The server may contain a database that defines groups of remote control station that can be connected to groups of robots. The database can be edited to vary the stations and robots within a group. The system may also allow for connectivity between a remote control station at a user programmable time window.

公开(公告)号：US09361021B2

公开(公告)日：2016-06-07

申请号：US14550750

申请日：2014-11-21

Applicant: InTouch Technologies, Inc. ,  iRobot Corporation

Inventor： Charles S. Jordan ,  Andy Young ,  Mei Sheng Ng ,  Yair Lurie ,  Fuji Lai ,  Timothy C. Wright ,  John Cody Herzog ,  Blair Whitney ,  Bill Rizzi ,  James Ballantyne ,  Yulun Wang ,  Cheuk Wah Wong ,  Justin Kearns ,  Orjeta Taka ,  Ramchandra Karandikar

IPC: H04N7/14 ,  G06F3/0488 ,  G06Q10/10 ,  G06F19/00 ,  G06F3/0484 ,  G06Q50/22

CPC classification number: G16H40/63 ,  G06F3/04847 ,  G06F3/04883 ,  G06F19/00 ,  G06F19/3418 ,  G06Q10/10 ,  G06Q50/22 ,  H04N7/142 ,  H04N7/147

Abstract: The present disclosure describes various aspects of remote presence interfaces (RPIs) for use on portable electronic devices (PEDs) to interface with remote telepresence devices. An RPI may allow a user to interact with a telepresence device, view a live video feed, provide navigational instructions, and/or otherwise interact with the telepresence device. The RPI may allow a user to manually, semi-autonomously, or autonomously control the movement of the telepresence device. One or more panels associated with a video feed, patient data, calendars, date, time, telemetry data, PED data, telepresence device data, healthcare facility information, healthcare practitioner information, menu tabs, settings controls, and/or other features may be utilized via the RPI.

Abstract translation: 本公开描述了用于在便携式电子设备（PED）上用于与远程远程呈现设备接口的远程存在接口（RPI）的各个方面。 RPI可以允许用户与远程呈现设备进行交互，查看实时视频馈送，提供导航指令，和/或以其他方式与网真设备进行交互。 RPI可以允许用户手动，半自主地或自主地控制远程呈现设备的移动。 与视频馈送相关联的一个或多个面板，患者数据，日历，日期，时间，遥测数据，PED数据，远程呈现设备数据，医疗机构信息，保健从业人员信息，菜单选项卡，设置控件和/或其他特征可以是 通过RPI使用。

公开(公告)号：USRE45870E1

公开(公告)日：2016-01-26

申请号：US13543225

申请日：2012-07-06

Applicant: Yulun Wang ,  Louis Kavoussi

Inventor： Yulun Wang ,  Louis Kavoussi

IPC: B25J5/00 ,  B25J9/18 ,  G06F19/00 ,  B25J9/16 ,  G05D1/00 ,  B25J19/02 ,  B25J9/00 ,  B25J11/00 ,  G05D1/02 ,  H04N7/18

CPC classification number: G06F19/3418 ,  B25J5/007 ,  B25J9/0003 ,  B25J9/1602 ,  B25J9/162 ,  B25J9/163 ,  B25J9/1633 ,  B25J9/1689 ,  B25J9/1692 ,  B25J11/0005 ,  B25J19/022 ,  B25J19/023 ,  G05D1/0038 ,  G05D1/0225 ,  G05D2201/0206 ,  G05D2201/0211 ,  G06F19/00 ,  G06F19/3456 ,  G16H10/60 ,  H04N7/142 ,  H04N7/185

Abstract: A method for remotely monitoring a patient. The method includes generating and transmitting input commands to the robot from a remote station. The remote station may include a personal computer that is operated by a doctor. The input commands can move the robot so that a video image and sounds of the patient can be captured by a robot camera and microphone, respectively, and transmitted back to the remote station. The robot may also have a monitor and a speaker to allow for two-way videoconferencing between the patient and a doctor at the remote station. The robot can move from room to room so that a doctor can make “patient rounds” within a medical facility. The system thus allows a doctor visit patients from a remote location, thereby improving the frequency of visits and the quality of medical care.REEXAMINATION RESULTSThe questions raised in reexamination proceeding No. 90/012,069, filed Dec. 22, 2011, have been considered, and the results thereof are reflected in this reissue patent which constitutes the reexamination certificate required by 35 U.S.C. 307 as provided in 37 CFR 1.570(e) for ex parte reexaminations, or the reexamination certificate required by 35 U.S.C. 316 as provided in 37 CFR 1.997(e) for inter partes reexaminations.

Abstract translation: 一种用于远程监测患者的方法。 该方法包括从远程站向机器人生成和发送输入命令。 远程站可以包括由医生操作的个人计算机。 输入命令可以移动机器人，使得可以分别由机器人相机和麦克风捕获患者的视频图像和声音，并将其发送回远程站。 机器人还可以具有监视器和扬声器，以允许患者和远端站的医生之间进行双向视频会议。 机器人可以从一个房间移动到另一个房间，以便医生可以在医疗机构内进行“病人回合”。 因此，该系统允许医生访问偏远地区的患者，从而提高访问频率和医疗质量。 重审结果2011年12月22日提交的第90 / 012,069号复审程序中提出的问题已被考虑，其结果反映在该重新发行专利中，构成35U.S.C.所要求的复审证书。 根据第37 CFR 1.570（e）的规定，单方面复审，或35 U.S.C.所要求的复审证书。 按照第37 CFR 1.997（e）条的规定进行跨部门重新审查。

公开(公告)号：US09174342B2

公开(公告)日：2015-11-03

申请号：US14550743

申请日：2014-11-21

Applicant: InTouch Technologies, Inc. ,  iRobot Corporation

Inventor： Marco Pinter ,  Fuji Lai ,  Daniel Steven Sanchez ,  James Ballantyne ,  David Bjorn Roe ,  Yulun Wang ,  Charles S. Jordan ,  Orjeta Taka ,  Cheuk Wah Wong

IPC: G05B19/18 ,  B25J9/16 ,  G06Q50/22 ,  G06F19/00

CPC classification number: B25J9/1676 ,  G06F19/00 ,  G06F19/3418 ,  G06Q50/22 ,  G16H40/67 ,  Y10S901/01 ,  Y10S901/47 ,  Y10S901/49

Abstract: Devices, systems, and methods for social behavior of a telepresence robot are disclosed herein. A telepresence robot may include a drive system, a control system, an object detection system, and a social behaviors component. The drive system is configured to move the telepresence robot. The control system is configured to control the drive system to drive the telepresence robot around a work area. The object detection system is configured to detect a human in proximity to the telepresence robot. The social behaviors component is configured to provide instructions to the control system to cause the telepresence robot to operate according to a first set of rules when a presence of one or more humans is not detected and operate according to a second set of rules when the presence of one or more humans is detected.

Abstract translation: 本文公开了用于远程呈现机器人的社会行为的设备，系统和方法。 远程呈现机器人可以包括驱动系统，控制系统，对象检测系统和社交行为组件。 驱动系统配置为移动远程呈现机器人。 控制系统被配置为控制驱动系统以驱动远程呈现机器人围绕工作区域。 物体检测系统被配置为检测靠近远程呈现机器人的人。 社会行为组件被配置为向控制系统提供指令，以使当远程呈现机器人在没有检测到一个或多个人的存在的情况下根据第一组规则操作时，当存在时根据第二组规则来操作 检测到一个或多个人。

公开(公告)号：US09098611B2

公开(公告)日：2015-08-04

申请号：US13830334

申请日：2013-03-14

Applicant: INTOUCH HEALTH

Inventor： Marco Pinter ,  Charles S. Jordan ,  Daniel Sanchez ,  Kevin Hanrahan ,  Chris Lambrecht ,  Kelton Temby

IPC: H04N7/14 ,  G06F19/00 ,  H04N7/18

CPC classification number: H04N7/147 ,  G06F19/00 ,  G06F19/3418 ,  G11B27/005 ,  G11B27/036 ,  G11B27/102 ,  G11B27/34 ,  H04N5/272 ,  H04N5/77 ,  H04N7/142 ,  H04N7/181 ,  H04N7/183 ,  H04N7/185

Abstract: A telepresence device may relay video, audio, and/or measurement data to a user operating a control device. A user interface may permit the user to quickly view and/or understand temporally and/or spatially disparate information. The telepresence device may pre-gather looped video of spatially disparate areas in an environment. A temporal control mechanism may start video playback at a desired point in a current or historical video segment. Notations may be associated with time spans in a video and recalled by capturing an image similar to a frame in the time span of the video. An area of interest may be selected and video containing the area of interest may be automatically found. Situational data may be recorded and used to recall video segments of interest. The telepresence device may synchronize video playback and movement. A series of videos may be recorded at predetermined time intervals to capture visually trending information.

Abstract translation: 远程呈现设备可以将视频，音频和/或测量数据中继到操作控制设备的用户。 用户界面可以允许用户快速查看和/或理解时间上和/或空间上不同的信息。 远程呈现设备可以在环境中预先收集空间上不同区域的循环视频。 时间控制机制可以在当前或历史视频段中的期望点开始视频回放。 记录可能与视频中的时间跨度相关联，并且通过在视频的时间间隔中捕获类似于帧的图像而被调用。 可以选择感兴趣的区域，并且可以自动找到包含感兴趣区域的视频。 情境数据可以被记录并用于召回感兴趣的视频段。 远程呈现设备可以同步视频播放和移动。 可以以预定的时间间隔记录一系列视频以捕获视觉上的趋势信息。

公开(公告)号：US08780165B2

公开(公告)日：2014-07-15

申请号：US13549971

申请日：2012-07-16

Applicant: Yulun Wang ,  Charles S. Jordan ,  Marco Pinter ,  Daniel Steven Sanchez ,  Kevin Hanrahan

Inventor： Yulun Wang ,  Charles S. Jordan ,  Marco Pinter ,  Daniel Steven Sanchez ,  Kevin Hanrahan

IPC: H04N7/14

CPC classification number: H04N7/147 ,  G06F19/00 ,  G06F19/3418 ,  H04N7/14 ,  H04N7/142 ,  H04N21/4788

Abstract: A tele-presence system that includes a portable robot face coupled to a remote station. The robot face includes a robot monitor, a robot camera, a robot speaker and a robot microphone. The remote station includes a station monitor, a station camera, a station speaker and a station microphone. The portable robot face can be attached to a platform mounted to the ceiling of an ambulance. The portable robot face can be used by a physician at the remote station to provide remote medical consultation. When the patient is moved from the ambulance the portable robot face can be detached from the platform and moved with the patient.

Abstract translation: 包括耦合到远程站的便携式机器人面部的远程存在系统。 机器人面部包括机器人监视器，机器人相机，机器人扬声器和机器人麦克风。 远程站包括站监视器，​​站摄像机，站扬声器和站麦克风。 便携式机器人面部可以安装在安装在救护车天花板上的平台上。 便携式机器人面部可以由远程站的医生使用以提供远程医疗咨询。 当病人从救护车上移动时，便携式机器人面部可以从平台上拆下并与病人一起移动。

公开(公告)号：US08670017B2

公开(公告)日：2014-03-11

申请号：US12717806

申请日：2010-03-04

Applicant: David Stuart ,  Daniel Steven Sanchez ,  Fuji Lai ,  Kevin Hanrahan ,  Charles S. Jordan ,  David Roe ,  James Rosenthal ,  Amante Mangaser ,  Blair Whitney ,  Derek Walters

Inventor： David Stuart ,  Daniel Steven Sanchez ,  Fuji Lai ,  Kevin Hanrahan ,  Charles S. Jordan ,  David Roe ,  James Rosenthal ,  Amante Mangaser ,  Blair Whitney ,  Derek Walters

IPC: H04N7/15 ,  G06F17/00 ,  G05B15/00

CPC classification number: H04N7/142 ,  B25J9/1689 ,  B25J9/1697 ,  G06F19/00 ,  G06F19/321 ,  G06F19/3418 ,  H04L65/403 ,  H04L67/10 ,  H04N5/23203 ,  H04N5/23222 ,  H04N5/23293 ,  H04N5/247 ,  H04N5/265 ,  H04N7/185

Abstract: A tele-presence system that includes a cart. The cart includes a robot face that has a robot monitor, a robot camera, a robot speaker, a robot microphone, and an overhead camera. The system also includes a remote station that is coupled to the robot face and the overhead camera. The remote station includes a station monitor, a station camera, a station speaker and a station microphone. The remote station can display video images captured by the robot camera and/or overhead camera. By way of example, the cart can be used in an operating room, wherein the overhead camera can be placed in a sterile field and the robot face can be used in a non-sterile field. The user at the remote station can conduct a teleconference through the robot face and also obtain a view of a medical procedure through the overhead camera.

Abstract translation: 包括购物车的远程存在系统。 推车包括具有机器人监视器，机器人相机，机器人扬声器，机器人麦克风和高架摄像机的机器人面部。 该系统还包括耦合到机器人面部和顶置摄像机的远程站。 远程站包括站监视器，​​站摄像机，站扬声器和站麦克风。 远程站可以显示由机器人摄像机和/或高架摄像头拍摄的视频图像。 作为示例，推车可以在手术室中使用，其中顶置式照相机可以放置在无菌区域中，并且机器人面部可以在非无菌区域中使用。 远程站的用户可以通过机器人面进行电话会议，并通过架空摄像机获得医疗程序的视图。

公开(公告)号：US20130155221A1

公开(公告)日：2013-06-20

申请号：US13770138

申请日：2013-02-19

Applicant: Yulun Wang ,  Charles S. Jordan ,  Keith P. Laby ,  Jonathan Southard ,  Marco Pinter ,  Brian Miller

Inventor： Yulun Wang ,  Charles S. Jordan ,  Keith P. Laby ,  Jonathan Southard ,  Marco Pinter ,  Brian Miller

IPC: G06F3/033

CPC classification number: G05D1/0038 ,  A61B34/30 ,  A61B34/70 ,  B25J5/007 ,  B25J11/009 ,  B25J13/02 ,  B25J19/023 ,  G05D2201/0206 ,  G06F3/033 ,  Y10S901/01

Abstract: A robotic system that includes a mobile robot and a remote input device. The input device may be a joystick that is used to move a camera and a mobile platform of the robot. The system may operate in a mode where the mobile platform moves in a camera reference coordinate system. The camera reference coordinate system is fixed to a viewing image provided by the camera so that movement of the robot corresponds to a direction viewed on a screen. This prevents disorientation during movement of the robot if the camera is panned across a viewing area.

Abstract translation: 包括移动机器人和远程输入设备的机器人系统。 输入设备可以是用于移动机器人的相机和移动平台的操纵杆。 该系统可以以移动平台在相机参考坐标系中移动的模式操作。 照相机参考坐标系固定在由照相机提供的观看图像上，使得机器人的移动对应于在屏幕上观看的方向。 这可以防止在机器人移动期间的偏移方向，如果相机在观看区域上进行平移。