公开(公告)号：US10990238B2

公开(公告)日：2021-04-27

申请号：US16582244

申请日：2019-09-25

Applicant: Soroco Private Limited

Inventor： George Peter Nychis ,  Rohan Narayan Murty

IPC: G06F3/00 ,  G06F17/00 ,  G06F3/0481 ,  G06F11/36 ,  G06F3/048 ,  G06F9/451 ,  G06F16/9535 ,  G06F9/44 ,  G06F9/455 ,  G06F9/448 ,  G06F8/38 ,  G06F11/07 ,  G06F11/32 ,  G06F3/0482 ,  G06F3/0484 ,  G06F11/34

Abstract: A system comprising at least one hardware processor configured to perform: accessing a software robot computer program for controlling at least one application program to perform a task comprising a first sub-task to be performed by a first application program; generating an object hierarchy comprising a plurality of objects corresponding to active graphical user interface (GUI) elements of the first application program; and controlling the first application program to perform the first sub-task. The controlling includes identifying, using the software robot computer program, a first action to perform in furtherance of the first sub-task; automatically accessing, in the object hierarchy, a first object corresponding to a first active GUI element of the first application program, the accessing comprising refreshing the object hierarchy; and automatically using the first object to cause the first application program to at least partially perform the first action.

公开(公告)号：US10698661B2

公开(公告)日：2020-06-30

申请号：US16153003

申请日：2018-10-05

Applicant: Soroco Private Limited

Inventor： Yoongu Kim ,  Abdul Qadir ,  Arjun Narayanaswamy ,  Rohan Narayan Murty ,  Shane Barratt ,  George Peter Nychis

IPC: G06F3/0484 ,  G06F11/36 ,  G06F9/44 ,  G06F3/0482 ,  G06F17/30 ,  G06F8/30 ,  G06F11/34 ,  G06F9/38 ,  H04L29/08 ,  G06F9/54 ,  G06F9/451 ,  G06F11/30 ,  G06N3/02

Abstract: According to at least one aspect, a system for collecting computer usage information is provided. The system includes a hardware processor, a display coupled to the hardware processor to display a user interface, and a computer-readable storage medium storing processor-executable instructions that cause the hardware processor to receive an indication of an action being performed by a user on the system, gather contextual information associated with the action responsive to the action performed by the user, store information indicative of the action and the contextual information in a volatile memory as an event, determine whether at least one event stored in the volatile memory includes personal information of the user, and write the at least one event stored in the volatile memory to an event log in a non-volatile memory responsive to a determination that the at least one event does not include personal information of the user.

公开(公告)号：US11157128B2

公开(公告)日：2021-10-26

申请号：US16745993

申请日：2020-01-17

Applicant: Soroco Private Limited

Inventor： George Peter Nychis ,  Rohan Narayan Murty

IPC: G06F3/00 ,  G06F3/0481 ,  G06F11/36 ,  G06F3/048 ,  G06F9/451 ,  G06F16/9535 ,  G06F9/44 ,  G06F9/455 ,  G06F9/448 ,  G06F8/38 ,  G06F11/07 ,  G06F11/32 ,  G06F3/0482 ,  G06F3/0484 ,  G06F11/34

Abstract: A system for remotely controlling multiple application programs executing on multiple respective physical computing devices, the system comprising a first computing device, comprising a first processor, and configured to execute a first application program; a second computing device, comprising a second processor, and configured to execute a second application program; and a controller configured to perform: generating, based on first information obtained from the first computing device and second information obtained from the second computing device, a global object hierarchy comprising a plurality of objects corresponding to active graphical user interface (GUI) elements of the first application program and the second application program; controlling the first application program to perform the first sub-task at least in part by using the global object hierarchy; and controlling the second application program to perform the second sub-task at least in part by using the global object hierarchy.

公开(公告)号：US20210149641A1

公开(公告)日：2021-05-20

申请号：US17117369

申请日：2020-12-10

Applicant: Soroco Private Limited

Inventor： Yoongu Kim ,  Abdul Qadir ,  Arjun Narayanaswamy ,  Rohan Narayan Murty ,  Shane Barratt ,  George Peter Nychis

IPC: G06F8/30 ,  G06F11/34 ,  G06F9/38 ,  H04L29/08 ,  G06F9/54 ,  G06F9/451 ,  G06F11/30 ,  G06N3/02

Abstract: According to at least one aspect, a system for analyzing computer usage data of a user to identify an underlying task being performed by the user is provided. The system includes a hardware processor and a non-transitory computer-readable storage medium storing processor-executable instructions that, when executed by the hardware processor, cause the hardware processor to perform: receiving a plurality of events each indicative of an action performed by a user and contextual information associated with the action performed by the user, clustering the plurality of events to generate a plurality of clustered events, identifying a plurality of sub-tasks in the plurality of clustered events that each comprise a sequence of clustered events, identifying a task in the plurality of clustered events being performed by the user that comprises at least one sub-task, and generating a score for the task indicative of a difficulty of automating the task.

公开(公告)号：US10983660B2

公开(公告)日：2021-04-20

申请号：US16842363

申请日：2020-04-07

Applicant: Soroco Private Limited

Inventor： George Peter Nychis ,  Rohan Narayan Murty

IPC: G06F9/451 ,  G06F3/0481 ,  G06F11/36 ,  G06F3/048 ,  G06F16/9535 ,  G06F9/44 ,  G06F9/455 ,  G06F9/448 ,  G06F8/38 ,  G06F11/07 ,  G06F11/32 ,  G06F3/0482 ,  G06F3/0484 ,  G06F11/34

Abstract: A system comprising at least one hardware processor; at least one non-transitory computer-readable storage medium storing processor-executable instructions that, when executed by the at least one hardware processor, cause the at least one hardware processor to perform: generating an object hierarchy comprising a plurality of objects corresponding to active graphical user interface (GUI) elements of a first application program, the generating comprising: obtaining a hierarchical representation of the active GUI elements of the application program; generating an object for each of at least some of the active GUI elements represented in the hierarchical representation; and organizing the generated objects into the object hierarchy based on relationships among active GUI elements represented in the hierarchical representation; and controlling, using software robot computer program and the generated object hierarchy, the first application program to perform the first sub-task.

公开(公告)号：US20200183656A1

公开(公告)日：2020-06-11

申请号：US16788726

申请日：2020-02-12

Applicant: Soroco Private Limited

Inventor： Yoongu Kim ,  Abdul Qadir ,  Arjun Narayanaswamy ,  Rohan Narayan Murty ,  Shane Barratt ,  George Peter Nychis

IPC: G06F8/30 ,  G06N3/02 ,  G06F11/34 ,  G06F11/30 ,  G06F9/451 ,  G06F9/54 ,  H04L29/08 ,  G06F9/38

Abstract: According to at least one aspect, a system for analyzing computer usage data of a user to identify an underlying task being performed by the user is provided. The system includes a hardware processor and a non-transitory computer-readable storage medium storing processor-executable instructions that, when executed by the hardware processor, cause the hardware processor to perform: receiving a plurality of events each indicative of an action performed by a user and contextual information associated with the action performed by the user, clustering the plurality of events to generate a plurality of clustered events, identifying a plurality of sub-tasks in the plurality of clustered events that each comprise a sequence of clustered events, identifying a task in the plurality of clustered events being performed by the user that comprises at least one sub-task, and generating a score for the task indicative of a difficulty of automating the task.

公开(公告)号：US20190034173A1

公开(公告)日：2019-01-31

申请号：US16153003

申请日：2018-10-05

Applicant: Soroco Private Limited

Inventor： Yoongu Kim ,  Abdul Qadir ,  Arjun Narayanaswamy ,  Rohan Narayan Murty ,  Shane Barratt ,  George Peter Nychis

IPC: G06F8/30 ,  G06F11/34 ,  G06F11/30 ,  G06F9/451 ,  H04L29/08 ,  G06F9/54 ,  G06F9/38 ,  G06N3/02

Abstract: According to at least one aspect, a system for collecting computer usage information is provided. The system includes a hardware processor, a display coupled to the hardware processor to display a user interface, and a computer-readable storage medium storing processor-executable instructions that cause the hardware processor to receive an indication of an action being performed by a user on the system, gather contextual information associated with the action responsive to the action performed by the user, store information indicative of the action and the contextual information in a volatile memory as an event, determine whether at least one event stored in the volatile memory includes personal information of the user, and write the at least one event stored in the volatile memory to an event log in a non-volatile memory responsive to a determination that the at least one event does not include personal information of the user.

公开(公告)号：US12050889B2

公开(公告)日：2024-07-30

申请号：US17117369

申请日：2020-12-10

Applicant: Soroco Private Limited

Inventor： Yoongu Kim ,  Abdul Qadir ,  Arjun Narayanaswamy ,  Rohan Narayan Murty ,  Shane Barratt ,  George Peter Nychis

IPC: G06F8/30 ,  G06F9/38 ,  G06F9/451 ,  G06F9/54 ,  G06F11/30 ,  G06F11/34 ,  G06N3/02 ,  H04L67/50 ,  H04L67/75

CPC classification number: G06F8/30 ,  G06F9/3858 ,  G06F9/451 ,  G06F9/542 ,  G06F11/3051 ,  G06F11/3414 ,  G06F11/3423 ,  G06F11/3438 ,  G06F11/3447 ,  G06F11/3476 ,  G06N3/02 ,  H04L67/535 ,  H04L67/75 ,  G06F2201/81

Abstract: According to at least one aspect, a system for analyzing computer usage data of a user to identify an underlying task being performed by the user is provided. The system includes a hardware processor and a non-transitory computer-readable storage medium storing processor-executable instructions that, when executed by the hardware processor, cause the hardware processor to perform: receiving a plurality of events each indicative of an action performed by a user and contextual information associated with the action performed by the user, clustering the plurality of events to generate a plurality of clustered events, identifying a plurality of sub-tasks in the plurality of clustered events that each comprise a sequence of clustered events, identifying a task in the plurality of clustered events being performed by the user that comprises at least one sub-task, and generating a score for the task indicative of a difficulty of automating the task.

公开(公告)号：US10802662B2

公开(公告)日：2020-10-13

申请号：US16291840

申请日：2019-03-04

Applicant: Soroco Private Limited

Inventor： George Peter Nychis ,  Rohan Narayan Murty

IPC: G06F17/00 ,  G06F3/00 ,  G06F3/0481 ,  G06F11/36 ,  G06F3/048 ,  G06F9/451 ,  G06F16/9535 ,  G06F9/44 ,  G06F9/455 ,  G06F9/448 ,  G06F8/38 ,  G06F11/07 ,  G06F11/32 ,  G06F3/0482 ,  G06F3/0484 ,  G06F11/34

Abstract: A system, comprising at least one computer hardware processor; and at least one non-transitory computer-readable storage medium storing processor-executable instructions that, when executed by the at least one computer hardware processor, cause the at least one computer hardware processor to perform: generating an object hierarchy comprising a plurality of objects corresponding to active graphical user interface (GUI) elements of a first application program; and controlling the first application program to perform a first sub-task. The controlling includes automatically accessing, in the object hierarchy, a first object corresponding to an active GUI element of the first application program, the accessing comprising searching for the first object in the object hierarchy, the searching comprising modifying the object hierarchy; and automatically using the first object to cause the first application program to at least partially perform a first action in furtherance of the first sub-task.

公开(公告)号：US20200019283A1

公开(公告)日：2020-01-16

申请号：US16582244

申请日：2019-09-25

Applicant: Soroco Private Limited

Inventor： George Peter Nychis ,  Rohan Narayan Murty

IPC: G06F3/0481 ,  G06F3/0484 ,  G06F9/455 ,  G06F3/0482 ,  G06F11/36 ,  G06F11/32 ,  G06F11/07 ,  G06F8/38 ,  G06F9/448 ,  G06F9/44 ,  G06F16/9535 ,  G06F9/451 ,  G06F3/048

Abstract: A system comprising at least one hardware processor configured to perform: accessing a software robot computer program for controlling at least one application program to perform a task comprising a first sub-task to be performed by a first application program; generating an object hierarchy comprising a plurality of objects corresponding to active graphical user interface (GUI) elements of the first application program; and controlling the first application program to perform the first sub-task. The controlling includes identifying, using the software robot computer program, a first action to perform in furtherance of the first sub-task; automatically accessing, in the object hierarchy, a first object corresponding to a first active GUI element of the first application program, the accessing comprising refreshing the object hierarchy; and automatically using the first object to cause the first application program to at least partially perform the first action.