Invention Grant
- Patent Title: Structure-level anomaly detection for unstructured logs
-
Application No.: US15830579Application Date: 2017-12-04
-
Publication No.: US10740170B2Publication Date: 2020-08-11
- Inventor: Biplob Debnath , Hui Zhang , Guofei Jiang
- Applicant: NEC Laboratories America, Inc.
- Applicant Address: JP
- Assignee: NEC Corporation
- Current Assignee: NEC Corporation
- Current Assignee Address: JP
- Agent Joseph Kolodka
- Main IPC: G06F11/07
- IPC: G06F11/07 ; G06F11/30 ; G06F11/34 ; G06F16/22 ; G06F16/28 ; G06F40/205

Abstract:
A computer-implemented method, computer program product, and computer processing system are provided. The method includes preprocessing, by a processor, a set of heterogeneous logs by splitting each of the logs into tokens to obtain preprocessed logs. Each of the logs in the set is associated with a timestamp and textual content in one or more fields. The method further includes generating, by the processor, a set of regular expressions from the preprocessed logs. The method also includes performing, by the processor, an unsupervised parsing operation by applying the regular expressions to the preprocessed logs to obtain a set of parsed logs and a set of unparsed logs, if any. The method additionally includes storing, by the processor, the set of parsed logs in a log analytics database and the set of unparsed logs in a debugging database.
Public/Granted literature
- US20180165147A1 STRUCTURE-LEVEL ANOMALY DETECTION FOR UNSTRUCTURED LOGS Public/Granted day:2018-06-14
Information query