公开(公告)号：US20150254162A1

公开(公告)日：2015-09-10

申请号：US14198223

申请日：2014-03-05

Applicant: Concurix Corporation

Inventor： Bryce B. BARIL ,  Alexander G. GOUNARES ,  Russell S. KRAJEC

IPC: G06F11/36 ,  G06F17/30

CPC classification number: G06F11/3636 ,  G06F11/3409 ,  G06F11/3452 ,  G06F11/3466 ,  G06F11/3616 ,  G06F16/951 ,  G06F16/955 ,  G06F2201/865

Abstract: Execution sequence information may be analyzed and quantified using n-gram analysis of functions executed by an application. The sequences of functions may be represented by n-grams, and the frequency of the various n-grams may indicate the behavior of the application in production, which may be compared to a test suite whose coverage may be quantified using a similar n-gram analysis. A coverage factor may compare the observed behavior of the application in production to the test suite for the application. The n-grams may be further quantified or prioritized by resource utilization, and several visualizations may be generated from the data.

Abstract translation: 可以使用应用程序执行的功能的n-gram分析来分析和量化执行序列信息。 函数序列可以由n-gram表示，并且各种n-gram的频率可以指示应用在生产中的行为，其可以与其覆盖可以使用类似的n-gram量化的测试套件进行比较 分析。 覆盖因子可能会将生产中应用程序的观察行为与应用程序的测试套件进行比较。 可以通过资源利用进一步量化或优先确定n克，并且可以从数据生成多个可视化。

公开(公告)号：US20150254163A1

公开(公告)日：2015-09-10

申请号：US14198296

申请日：2014-03-05

Applicant: Concurix Corporation

Inventor： Bryce B. BARIL ,  Alexander G. GOUNARES ,  Russell S. KRAJEC

IPC: G06F11/36

CPC classification number: G06F11/3636 ,  G06F11/3409 ,  G06F11/3452 ,  G06F11/3466 ,  G06F11/3664 ,  G06F11/3688 ,  G06F2201/865

Abstract: A behavior model for a software application may identify a set of execution sequences that begin from a set of origins. The sequences may be further defined by a set of exits. In some cases, the sequences may be decomposed into subsequences or n-grams. The execution sequences and their frequencies may define a usage or behavior model for the application. The sequences may be defined by semantic level operations of an application, which may be defined by functions, call backs, API calls, or other blocks of code execution. The behavior model may be used for determining code coverage, comparing versions of applications, and other uses.

Abstract translation: 用于软件应用的行为模型可以标识从一组起点开始的一组执行序列。 序列可以由一组出口进一步限定。 在某些情况下，序列可以分解成子序列或n克。 执行序列及其频率可以定义应用程序的使用或行为模型。 序列可以通过应用程序的语义级别操作定义，应用程序可以通过函数，回调函数，API调用或其他代码执行块定义。 行为模型可用于确定代码覆盖率，比较应用程序的版本和其他用途。

公开(公告)号：US20150254165A1

公开(公告)日：2015-09-10

申请号：US14198271

申请日：2014-03-05

Applicant: CONCURIX CORPORATION

Inventor： Bryce B. BARIL ,  Alexander G. GOUNARES ,  Russell S. KRAJEC

IPC: G06F11/36

CPC classification number: G06F11/3676 ,  G06F11/3664 ,  G06F11/3688

Abstract: Regression testing of an application may gather performance tests for multiple functions within an application and determine when performance changes from one version of the application to another. The analysis may be further broken down by input sequences that may be processed by various functions. A detailed regression analysis may be presented as a heat map or other visualizations. A regression testing system may be launched during a build process by automatically launching a set of performance tests against an application. In many cases, the application may be executed in a system with a known or consistent performance capabilities. The application may be executed and tested in a new version and at least one prior version on the same hardware and software execution environment, so that results may be normalized from one execution run to another. A regression testing system may be deployed as a paid-for service that may integrate into a source code repository.

Abstract translation: 应用程序的回归测试可以收集应用程序中多个功能的性能测试，并确定性能从应用程序的某个版本到另一个版本的变化。 可以通过可由各种功能处理的输入序列进一步细分分析。 详细的回归分析可以表示为热图或其他可视化。 可以在构建过程中通过针对应用程序自动启动一组性能测试来启动回归测试系统。 在许多情况下，应用程序可以在具有已知或一致的性能能力的系统中执行。 应用程序可以在相同的硬件和软件执行环境中以新版本和至少一个先前版本来执行和测试，使得结果可以从一个执行运行归一化到另一个。 回归测试系统可以部署为可以集成到源代码存储库中的付费服务。

公开(公告)号：US20150254172A1

公开(公告)日：2015-09-10

申请号：US14198254

申请日：2014-03-05

Applicant: Concurix Corporation

Inventor： Bryce B. BARIL ,  Alexander G. GOUNARES ,  Russell S. KRAJEC

IPC: G06F11/36

CPC classification number: G06F11/3688 ,  G06F11/3616

Abstract: N-grams of input streams or functions executed by an application may be analyzed to identify security breaches or other anomalous behavior. A histogram of n-grams representing sequences of executed functions or input streams may be generated through baseline testing or production use. An alerting system may compare real time n-gram observations to the histogram of n-grams to identify security breaches or other changes in application behavior that may be anomalous. An alert may be generated that identifies the anomalous behavior. The alerting system may be trained using known good datasets and may identify deviations as bad behavior. The alerting system may be trained using known bad datasets and may identify matching behavior as bad behavior.

Abstract translation: 可以分析由应用程序执行的输入流或功能的N克，以识别安全漏洞或其他异常行为。 可以通过基线测试或生产使用来生成表示执行功能或输入流的序列的n-gram直方图。 警报系统可以将实时n-gram观察值与n-gram的直方图进行比较，以识别可能是异常的安全漏洞或应用程序行为的其他变化。 可能会产生识别异常行为的警报。 可以使用已知的良好数据集来训练警报系统，并且可以将偏差识别为不良行为。 可以使用已知的不良数据集来训练警报系统，并且可以将匹配行为识别为不良行为。

公开(公告)号：US20150254161A1

公开(公告)日：2015-09-10

申请号：US14198284

申请日：2014-03-05

Applicant: Concurix Corporation

Inventor： Bryce B. BARIL ,  Alexander G. GOUNARES ,  Russell S. KRAJEC

IPC: G06F11/36 ,  G06F11/34

CPC classification number: G06F11/3616 ,  G06F11/3409 ,  G06F11/3428 ,  G06F11/3447 ,  G06F11/3452 ,  G06F11/3466 ,  G06F2201/865

Abstract: Comparisons of different versions of an application may be compared using a behavior model of the application. A behavior model may be derived from n-gram analysis of observations of the application in production. The behavior model may include sequences of inputs received by the application or functions performed by the application, where each sequence is an n-gram observed in tracer data. Each n-gram may be coupled with a resource consumption to give a behavior model with performance data. A regression analysis may apply a behavior model derived from a first version of an application to the performance observations of a new version to create an expected performance metric for the new version. A similarly calculated metric from a previous version may be compared to the metric from a new version to determine an improvement or degradation of performance.

Abstract translation: 可以使用应用程序的行为模型来比较应用程序的不同版本的比较。 行为模型可以从生产中应用的观察结果的n-gram分析中得出。 行为模型可以包括由应用程序接收的输入序列或由应用程序执行的功能，其中每个序列是在跟踪器数据中观察到的n-gram。 每个n-gram可以与资源消耗相结合，以给出具有性能数据的行为模型。 回归分析可以将来自应用程序的第一版本的行为模型应用于新版本的性能观察，以创建新版本的预期性能指标。 可以将来自先前版本的类似计算的度量与来自新版本的度量进行比较，以确定性能的改善或降级。

公开(公告)号：US20150254151A1

公开(公告)日：2015-09-10

申请号：US14198239

申请日：2014-03-05

Applicant: Concurix Corporation

Inventor： Bryce B. BARIL ,  Alexander G. GOUNARES ,  Russell S. KRAJEC

IPC: G06F11/30 ,  G06F11/34

CPC classification number: G06F11/3003 ,  G06F11/3082 ,  G06F21/577 ,  G06F2201/865

Abstract: Input sequence information may be analyzed and quantified using n-gram analysis of inputs received by an application. The sequences of inputs may be represented by n-grams, and the frequency of the various n-grams may indicate the ‘real world’ uses of the application in production, which may be compared to a test suite whose coverage may be quantified using a similar n-gram analysis. A coverage factor may compare the observed inputs to the application in production to the test suite for the application. The n-grams may be further quantified or prioritized by resource utilization and several visualizations may be generated from the data.

Abstract translation: 可以使用应用程序接收的输入的n-gram分析来分析和量化输入序列信息。 输入序列可以用n-gram表示，并且各种n-gram的频率可以指示应用在生产中的“真实世界”使用，其可以与其覆盖可以使用 类似的n-gram分析。 覆盖因子可将观察到的输入与生产中的应用程序相比较，以应用于测试套件。 可以通过资源利用进一步量化或优先确定n克，并且可以从数据生成多个可视化。