Invention Grant
- Patent Title: Software user assistance through image processing
-
Application No.: US17464540Application Date: 2021-09-01
-
Publication No.: US11709691B2Publication Date: 2023-07-25
- Inventor: Christian Martick
- Applicant: SAP SE
- Applicant Address: DE Walldorf
- Assignee: SAP SE
- Current Assignee: SAP SE
- Current Assignee Address: DE Walldorf
- Agency: Fountainhead Law Group P.C.
- Main IPC: G06F9/451
- IPC: G06F9/451 ; G06V30/14

Abstract:
Software User Assistance (UA) is afforded from captured User Interface (UI) screen images, with reference to persisted Machine Learning (ML) models. The captured screen images are processed—e.g., using rasterization, Optical Character Recognition (OCR), and/or establishment of a coordinate system—with individual UI elements being determined therefrom. Referencing the persisted ML models, the software application/application state for the captured image is identified. UA data relevant to that application/application state is generated from the model, and then provided to the user (e.g., in a text box overlying the UI screen). Through the capture and processing of UI screen images, embodiments afford a homogenous UA experience for installation, maintenance, and/or upgrade of heterogeneous members of a larger overall landscape, over software lifecycles. Embodiments may be deployed locally on a frontend computer, in order to avoid exporting UI images due to privacy and/or security concerns.
Public/Granted literature
- US20230063759A1 Software User Assistance Through Image Processing Public/Granted day:2023-03-02
Information query