Machine learning system and method for determining or inferring user action and intent based on screen image analysis

    公开(公告)号:US12112526B2

    公开(公告)日:2024-10-08

    申请号:US18326756

    申请日:2023-05-31

    Applicant: M37 Inc.

    Inventor: Ali Jelveh

    Abstract: System(s) and method(s) that analyze image data associated with a computing screen operated by a user, and learns the image data (e.g., using pattern recognition, historical information analysis, user implicit and explicit training data, optical character recognition (OCR), video information, 360°/panoramic recordings, and so on) to concurrently glean information regarding multiple states of user interaction (e.g., analyzing data associated with multiple applications open on a desktop, mobile phone or tablet). A machine learning model is trained on analysis of graphical image data associated with screen display to determine or infer user intent. An input component receives image data regarding a screen display associated with user interaction with a computing device. An analysis component employs the model to determine or infer user intent based on the image data analysis; and an action component provisions services to the user as a function of the determined or inferred user intent. In an implementation, a gaming component gamifies interaction with the user in connection with explicitly training the model.

    Reading system, reading method, and storage medium

    公开(公告)号:US12087154B2

    公开(公告)日:2024-09-10

    申请号:US17078336

    申请日:2020-10-23

    Abstract: According to one embodiment, a reading system includes a calculator and a determiner. The calculator calculates a total value of luminances and fluctuation of the luminances in at least a portion of a second direction at each of a plurality of points in a first direction for at least a portion of an image subjected to a polar transformation. A meter is imaged in the image and includes a pointer, a display panel, and graduations. The pointer rotates around a rotation axis. The graduations are arranged along a circumferential direction around the rotation axis on the display panel. The polar transformation is referenced to a center of the meter. The first direction corresponds to the circumferential direction. The second direction corresponds to a diametrical direction from the center toward the graduations. The determiner uses the total value and the fluctuation to determine a position at which the pointer exists.

    Method and system for providing image-based interoperability with an application

    公开(公告)号:US11995428B2

    公开(公告)日:2024-05-28

    申请号:US17351721

    申请日:2021-06-18

    Applicant: Nice Ltd.

    CPC classification number: G06F8/65 G06F8/38 G06F9/451 G06V30/414 G06V2201/02

    Abstract: A system and method for enabling graphic-based interoperability between computer executed applications. A computer system operating as a client may display a graphical user interface (GUI) including control graphic items such as buttons, text boxes, etc. A process may examine the graphical image of the GUI to determine if there has been a change over time in the GUI as displayed which updates a control graphic item. If there has been a change over time in the GUI which updates a control graphic item, an action may be taken, for example updating properties of an object construct corresponding to the control graphic item, raising an event corresponding to an object construct corresponding to the control graphic item, or communicating an event to a process.

    DEFECT DETECTION METHOD AND DEVICE
    7.
    发明公开

    公开(公告)号:US20240104717A1

    公开(公告)日:2024-03-28

    申请号:US18461027

    申请日:2023-09-05

    Abstract: A defect detection method includes obtaining a first screen image and a second screen image of a screen module, in response to determining a defect area in the first screen image, determining an image feature correlation between the first screen image and the second screen image, and determining a defect detection result of the screen module based on the image feature correlation. The first screen image is an image displayed by a display screen collected when the display screen of the screen module is in a first test state. The second screen image is an image displayed by the display screen collected when the display screen is in a second test state. The defect area indicates that the screen module has a display defect.

Patent Agency Ranking