公开(公告)号：US10891112B2

公开(公告)日：2021-01-12

申请号：US16788726

申请日：2020-02-12

Applicant: Soroco Private Limited

Inventor： Yoongu Kim ,  Abdul Qadir ,  Arjun Narayanaswamy ,  Rohan Narayan Murty ,  Shane Barratt ,  George Peter Nychis

IPC: G06F8/30 ,  G06F11/34 ,  G06F9/38 ,  H04L29/08 ,  G06F9/54 ,  G06F9/451 ,  G06F11/30 ,  G06N3/02

Abstract: According to at least one aspect, a system for analyzing computer usage data of a user to identify an underlying task being performed by the user is provided. The system includes a hardware processor and a non-transitory computer-readable storage medium storing processor-executable instructions that, when executed by the hardware processor, cause the hardware processor to perform: receiving a plurality of events each indicative of an action performed by a user and contextual information associated with the action performed by the user, clustering the plurality of events to generate a plurality of clustered events, identifying a plurality of sub-tasks in the plurality of clustered events that each comprise a sequence of clustered events, identifying a task in the plurality of clustered events being performed by the user that comprises at least one sub-task, and generating a score for the task indicative of a difficulty of automating the task.

公开(公告)号：US20200272282A1

公开(公告)日：2020-08-27

申请号：US16842363

申请日：2020-04-07

Applicant: Soroco Private Limited

Inventor： George Peter Nychis ,  Rohan Narayan Murty

IPC: G06F3/0481 ,  G06F11/36 ,  G06F3/048 ,  G06F9/451 ,  G06F16/9535 ,  G06F9/44 ,  G06F9/455 ,  G06F9/448 ,  G06F8/38 ,  G06F11/07 ,  G06F11/32 ,  G06F3/0482 ,  G06F3/0484

Abstract: A system comprising at least one hardware processor; at least one non-transitory computer-readable storage medium storing processor-executable instructions that, when executed by the at least one hardware processor, cause the at least one hardware processor to perform: generating an object hierarchy comprising a plurality of objects corresponding to active graphical user interface (GUI) elements of a first application program, the generating comprising: obtaining a hierarchical representation of the active GUI elements of the application program; generating an object for each of at least some of the active GUI elements represented in the hierarchical representation; and organizing the generated objects into the object hierarchy based on relationships among active GUI elements represented in the hierarchical representation; and controlling, using software robot computer program and the generated object hierarchy, the first application program to perform the first sub-task.

公开(公告)号：US10671235B2

公开(公告)日：2020-06-02

申请号：US15059770

申请日：2016-03-03

Applicant: Soroco Private Limited

Inventor： George Peter Nychis ,  Rohan Narayan Murty

IPC: G06F3/00 ,  G06F3/0481 ,  G06F11/36 ,  G06F3/048 ,  G06F9/451 ,  G06F16/9535 ,  G06F9/44 ,  G06F9/455 ,  G06F9/448 ,  G06F8/38 ,  G06F11/07 ,  G06F11/32 ,  G06F3/0482 ,  G06F3/0484 ,  G06F11/34

Abstract: A system comprising at least one computer hardware processor; and at least one computer-readable storage medium storing processor-executable instructions that, when executed by the at least one computer hardware processor, cause the at least one computer hardware processor to perform: generating an object hierarchy comprising a plurality of objects corresponding to active graphical user interface (GUI) elements of at least one of a first application program and a second application program; controlling the first application program to perform a first sub-task of a task at least in part by using the object hierarchy; and controlling the second application program to perform a second sub-task of the task at least in part by using the object hierarchy, wherein the first and second application programs are configured to execute at least in part by using different GUI application libraries.

公开(公告)号：US10474313B2

公开(公告)日：2019-11-12

申请号：US15059638

申请日：2016-03-03

Applicant: Soroco Private Limited

Inventor： George Peter Nychis ,  Rohan Narayan Murty

IPC: G06F17/00 ,  G06F3/00 ,  G06F3/0481 ,  G06F11/36 ,  G06F3/048 ,  G06F9/451 ,  G06F16/9535 ,  G06F9/44 ,  G06F9/455 ,  G06F9/448 ,  G06F3/0482 ,  G06F3/0484 ,  G06F8/38 ,  G06F11/07 ,  G06F11/32

Abstract: A system comprising at least one hardware processor configured to perform: accessing a software robot computer program for controlling at least one application program to perform a task comprising a first sub-task to be performed by a first application program; generating an object hierarchy comprising a plurality of objects corresponding to active graphical user interface (GUI) elements of the first application program; and controlling the first application program to perform the first sub-task. The controlling includes identifying, using the software robot computer program, a first action to perform in furtherance of the first sub-task; automatically accessing, in the object hierarchy, a first object corresponding to a first active GUI element of the first application program, the accessing comprising refreshing the object hierarchy; and automatically using the first object to cause the first application program to at least partially perform the first action.

公开(公告)号：US20190302968A1

公开(公告)日：2019-10-03

申请号：US16428031

申请日：2019-05-31

Applicant: Soroco Private Limited

Inventor： George Peter Nychis ,  Rohan Narayan Murty

IPC: G06F3/0481 ,  G06F16/9535 ,  G06F11/36 ,  G06F11/32 ,  G06F11/07 ,  G06F9/455 ,  G06F8/38 ,  G06F3/0484 ,  G06F3/0482 ,  G06F9/451 ,  G06F9/448 ,  G06F9/44 ,  G06F3/048

Abstract: A system comprising at least one computer hardware processor configured to perform: generating an object hierarchy comprising a plurality of objects corresponding to active graphical user interface (GUI) elements of at least one application program; controlling the at least one application program to perform a task comprising a sequence of actions at least in part by using the object hierarchy to invoke actions in the sequence of actions.

公开(公告)号：US20190196665A1

公开(公告)日：2019-06-27

申请号：US16291840

申请日：2019-03-04

Applicant: Soroco Private Limited

Inventor： George Peter Nychis ,  Rohan Narayan Murty

IPC: G06F3/0481 ,  G06F16/9535 ,  G06F11/36 ,  G06F11/32 ,  G06F11/07 ,  G06F9/455 ,  G06F8/38 ,  G06F3/0484 ,  G06F3/0482 ,  G06F9/451 ,  G06F9/448 ,  G06F9/44 ,  G06F3/048

Abstract: A system, comprising at least one computer hardware processor; and at least one non-transitory computer-readable storage medium storing processor-executable instructions that, when executed by the at least one computer hardware processor, cause the at least one computer hardware processor to perform: generating an object hierarchy comprising a plurality of objects corresponding to active graphical user interface (GUI) elements of a first application program; and controlling the first application program to perform a first sub-task. The controlling includes automatically accessing, in the object hierarchy, a first object corresponding to an active GUI element of the first application program, the accessing comprising searching for the first object in the object hierarchy, the searching comprising modifying the object hierarchy; and automatically using the first object to cause the first application program to at least partially perform a first action in furtherance of the first sub-task.

公开(公告)号：US10310701B2

公开(公告)日：2019-06-04

申请号：US15942930

申请日：2018-04-02

Applicant: Soroco Private Limited

Inventor： George Peter Nychis ,  Rohan Narayan Murty

IPC: G06F9/44 ,  G06F9/445 ,  G06F9/448 ,  G06F3/048 ,  G06F3/0481 ,  G06F3/0484 ,  G06F11/36 ,  G06F9/451 ,  G06F16/9535 ,  G06F9/455 ,  G06F3/0482 ,  G06F8/38 ,  G06F11/07 ,  G06F11/32

Abstract: A system comprising at least one computer hardware processor configured to perform: generating an object hierarchy comprising a plurality of objects corresponding to active graphical user interface (GUI) elements of at least one application program; controlling the at least one application program to perform a task comprising a sequence of actions at least in part by using the object hierarchy to invoke actions in the sequence of actions.

公开(公告)号：US10268333B2

公开(公告)日：2019-04-23

申请号：US15059701

申请日：2016-03-03

Applicant: Soroco Private Limited

Inventor： George Peter Nychis ,  Rohan Narayan Murty

IPC: G06F17/00 ,  G06F3/00 ,  G06F3/0481 ,  G06F11/36 ,  G06F3/048 ,  G06F9/451 ,  G06F3/0482 ,  G06F3/0484 ,  G06F9/455 ,  G06F17/30 ,  G06F8/38 ,  G06F11/07 ,  G06F11/32

Abstract: A system, comprising at least one computer hardware processor; and at least one non-transitory computer-readable storage medium storing processor-executable instructions that, when executed by the at least one computer hardware processor, cause the at least one computer hardware processor to perform: generating an object hierarchy comprising a plurality of objects corresponding to active graphical user interface (GUI) elements of a first application program; and controlling the first application program to perform a first sub-task. The controlling includes automatically accessing, in the object hierarchy, a first object corresponding to an active GUI element of the first application program, the accessing comprising searching for the first object in the object hierarchy, the searching comprising modifying the object hierarchy; and automatically using the first object to cause the first application program to at least partially perform a first action in furtherance of the first sub-task.

公开(公告)号：US10156958B2

公开(公告)日：2018-12-18

申请号：US15059907

申请日：2016-03-03

Applicant: Soroco Private Limited

Inventor： George Peter Nychis ,  Rohan Narayan Murty

IPC: G06F3/0481 ,  G06F11/36 ,  G06F3/048 ,  G06F9/451 ,  G06F3/0482 ,  G06F3/0484 ,  G06F9/455 ,  G06F17/30 ,  G06F8/38

Abstract: A system comprising at least one hardware processor; at least one non-transitory computer-readable storage medium storing processor-executable instructions that, when executed by the at least one hardware processor, cause the at least one hardware processor to perform: generating an object hierarchy comprising a plurality of objects corresponding to active graphical user interface (GUI) elements of a first application program, the generating comprising: obtaining a hierarchical representation of the active GUI elements of the application program; generating an object for each of at least some of the active GUI elements represented in the hierarchical representation; and organizing the generated objects into the object hierarchy based on relationships among active GUI elements represented in the hierarchical representation; and controlling, using software robot computer program and the generated object hierarchy, the first application program to perform the first sub-task.

公开(公告)号：US10120653B2

公开(公告)日：2018-11-06

申请号：US15904138

申请日：2018-02-23

Applicant: Soroco Private Limited

Inventor： Yoongu Kim ,  Abdul Qadir ,  Arjun Narayanaswamy ,  Rohan Narayan Murty ,  Shane Barratt ,  George Peter Nychis

IPC: G06F3/0488 ,  G06F9/54 ,  G06F3/048 ,  G06F8/30 ,  G06F11/34 ,  G06N3/02 ,  G06F9/451 ,  G06F11/30

Abstract: According to at least one aspect, a system for collecting computer usage information is provided. The system includes a hardware processor, a display coupled to the hardware processor to display a user interface, and a computer-readable storage medium storing processor-executable instructions that cause the hardware processor to receive an indication of an action being performed by a user on the system, cause the system to wait before updating the user interface in response to the action performed by the user, gather contextual information associated with the action while the system is waiting to process the action performed by the user to update the user interface, cause the system to update the user interface in response to the action performed by the user after gathering the contextual information, and store information indicative of the action and the contextual information.