公开(公告)号：US20150082285A1

公开(公告)日：2015-03-19

申请号：US14549420

申请日：2014-11-20

Applicant: Concurix Corporation

Inventor： Ying LI ,  Alexander G. GOUNARES ,  Charles D. GARRETT ,  Russell S. KRAJEC

IPC: G06F11/36 ,  G06F9/44

CPC classification number: G06F11/3688 ,  G06F8/443 ,  G06F8/70 ,  G06F9/46 ,  G06F9/505 ,  G06F11/1471 ,  G06F11/323 ,  G06F11/3409 ,  G06F11/3414 ,  G06F11/3466 ,  G06F11/3495 ,  G06F11/3612 ,  G06F11/3624 ,  G06F11/3636 ,  G06F2201/805 ,  G06F2201/84 ,  G06F2201/865 ,  G06F2201/88 ,  H04L43/00

Abstract: An analysis system may perform network analysis on data gathered from an executing application. The analysis system may identify relationships between code elements and use tracer data to quantify and classify various code elements. In some cases, the analysis system may operate with only data gathered while tracing an application, while other cases may combine static analysis data with tracing data. The network analysis may identify groups of related code elements through cluster analysis, as well as identify bottlenecks from one to many and many to one relationships. The analysis system may generate visualizations showing the interconnections or relationships within the executing code, along with highlighted elements that may be limiting performance.

Abstract translation: 分析系统可以对从执行应用收集的数据执行网络分析。 分析系统可以识别代码元素之间的关系，并使用跟踪器数据来量化和分类各种代码元素。 在某些情况下，分析系统只能在跟踪应用程序时收集的数据进行操作，而其他情况可能会将静态分析数据与跟踪数据相结合。 网络分析可以通过聚类分析来识别相关代码元素的组，并且识别从一个到多个和多个到一个关系的瓶颈。 分析系统可以产生显示执行代码内的互连或关系的可视化，以及可能限制性能的突出显示的元素。

公开(公告)号：US20150067652A1

公开(公告)日：2015-03-05

申请号：US14455156

申请日：2014-08-08

Applicant: Concurix Corporation

Inventor： Tetsuo SETO ,  Alexander G. GOUNARES ,  Russell S. Krajec

IPC: G06F11/36 ,  G06F21/31

CPC classification number: G06F11/3636 ,  G06F11/34 ,  G06F11/3409 ,  G06F11/3466 ,  G06F11/3664 ,  G06F21/12 ,  G06F21/31 ,  G06F2201/865

Abstract: A module-specific tracing mechanism may trace the usage of a module on behalf of the module developer. The module may be used by multiple application developers, and the tracing system may collect and summarize data for the module in each of the different applications. The data may include usage data as well as performance data. Usage data may include anonymized data for each time the module may be invoked and called, and performance data may include the processing time, memory consumption, and other metrics. The module-specific tracing may be enabled or disabled by an application developer.

Abstract translation: 模块特定的跟踪机制可以代表模块开发人员跟踪模块的使用情况。 该模块可以由多个应用程序开发人员使用，跟踪系统可以收集和汇总每个不同应用程序中的模块的数据。 数据可以包括使用数据以及性能数据。 使用数据可以包括每当模块被调用和调用时的匿名数据，并且性能数据可以包括处理时间，存储器消耗和其他度量。 模块特定的跟踪可能被应用程序开发人员启用或禁用。

公开(公告)号：US20150254162A1

公开(公告)日：2015-09-10

申请号：US14198223

申请日：2014-03-05

Applicant: Concurix Corporation

Inventor： Bryce B. BARIL ,  Alexander G. GOUNARES ,  Russell S. KRAJEC

IPC: G06F11/36 ,  G06F17/30

CPC classification number: G06F11/3636 ,  G06F11/3409 ,  G06F11/3452 ,  G06F11/3466 ,  G06F11/3616 ,  G06F16/951 ,  G06F16/955 ,  G06F2201/865

Abstract: Execution sequence information may be analyzed and quantified using n-gram analysis of functions executed by an application. The sequences of functions may be represented by n-grams, and the frequency of the various n-grams may indicate the behavior of the application in production, which may be compared to a test suite whose coverage may be quantified using a similar n-gram analysis. A coverage factor may compare the observed behavior of the application in production to the test suite for the application. The n-grams may be further quantified or prioritized by resource utilization, and several visualizations may be generated from the data.

Abstract translation: 可以使用应用程序执行的功能的n-gram分析来分析和量化执行序列信息。 函数序列可以由n-gram表示，并且各种n-gram的频率可以指示应用在生产中的行为，其可以与其覆盖可以使用类似的n-gram量化的测试套件进行比较 分析。 覆盖因子可能会将生产中应用程序的观察行为与应用程序的测试套件进行比较。 可以通过资源利用进一步量化或优先确定n克，并且可以从数据生成多个可视化。

公开(公告)号：US20150067654A1

公开(公告)日：2015-03-05

申请号：US14455170

申请日：2014-08-08

Applicant: Concurix Corporation

Inventor： Tetsuo SETO ,  Alexander G. GOUNARES ,  Russell S. Krajec

IPC: G06F11/36 ,  G06F21/31

CPC classification number: G06F11/3636 ,  G06F21/31

Abstract: A tracing system may trace applications and their modules, and may make module-specific data available through various interfaces. The tracing system may collect tracer data while an application executes, and may preprocess the data into application-specific and module-specific databases. An analysis engine may further analyze and process these databases to create application-specific views and module-specific views into the data. The application-specific views may be intended for a developer of the application, while the module-specific views may have a public version accessible to everybody and a module developer version that may contain additional details that may be useful to the module developer.

Abstract translation: 跟踪系统可以跟踪应用程序及其模块，并且可以通过各种接口使模块特定的数据可用。 跟踪系统可以在应用程序执行时收集示踪器数据，并且可以将数据预处理成应用程序特定的和模块特定的数据库。 分析引擎可以进一步分析和处理这些数据库以将特定于应用的视图和模块特定的视图创建到数据中。 特定于应用程序的视图可能适用于应用程序的开发人员，而模块特定视图可能具有每个人可访问的公开版本，以及可能包含可能对模块开发人员有用的其他详细信息的模块开发人员版本。

公开(公告)号：US20150254163A1

公开(公告)日：2015-09-10

申请号：US14198296

申请日：2014-03-05

Applicant: Concurix Corporation

Inventor： Bryce B. BARIL ,  Alexander G. GOUNARES ,  Russell S. KRAJEC

IPC: G06F11/36

CPC classification number: G06F11/3636 ,  G06F11/3409 ,  G06F11/3452 ,  G06F11/3466 ,  G06F11/3664 ,  G06F11/3688 ,  G06F2201/865

Abstract: A behavior model for a software application may identify a set of execution sequences that begin from a set of origins. The sequences may be further defined by a set of exits. In some cases, the sequences may be decomposed into subsequences or n-grams. The execution sequences and their frequencies may define a usage or behavior model for the application. The sequences may be defined by semantic level operations of an application, which may be defined by functions, call backs, API calls, or other blocks of code execution. The behavior model may be used for determining code coverage, comparing versions of applications, and other uses.

Abstract translation: 用于软件应用的行为模型可以标识从一组起点开始的一组执行序列。 序列可以由一组出口进一步限定。 在某些情况下，序列可以分解成子序列或n克。 执行序列及其频率可以定义应用程序的使用或行为模型。 序列可以通过应用程序的语义级别操作定义，应用程序可以通过函数，回调函数，API调用或其他代码执行块定义。 行为模型可用于确定代码覆盖率，比较应用程序的版本和其他用途。

公开(公告)号：US20150254165A1

公开(公告)日：2015-09-10

申请号：US14198271

申请日：2014-03-05

Applicant: CONCURIX CORPORATION

Inventor： Bryce B. BARIL ,  Alexander G. GOUNARES ,  Russell S. KRAJEC

IPC: G06F11/36

CPC classification number: G06F11/3676 ,  G06F11/3664 ,  G06F11/3688

Abstract: Regression testing of an application may gather performance tests for multiple functions within an application and determine when performance changes from one version of the application to another. The analysis may be further broken down by input sequences that may be processed by various functions. A detailed regression analysis may be presented as a heat map or other visualizations. A regression testing system may be launched during a build process by automatically launching a set of performance tests against an application. In many cases, the application may be executed in a system with a known or consistent performance capabilities. The application may be executed and tested in a new version and at least one prior version on the same hardware and software execution environment, so that results may be normalized from one execution run to another. A regression testing system may be deployed as a paid-for service that may integrate into a source code repository.

Abstract translation: 应用程序的回归测试可以收集应用程序中多个功能的性能测试，并确定性能从应用程序的某个版本到另一个版本的变化。 可以通过可由各种功能处理的输入序列进一步细分分析。 详细的回归分析可以表示为热图或其他可视化。 可以在构建过程中通过针对应用程序自动启动一组性能测试来启动回归测试系统。 在许多情况下，应用程序可以在具有已知或一致的性能能力的系统中执行。 应用程序可以在相同的硬件和软件执行环境中以新版本和至少一个先前版本来执行和测试，使得结果可以从一个执行运行归一化到另一个。 回归测试系统可以部署为可以集成到源代码存储库中的付费服务。

公开(公告)号：US20150254172A1

公开(公告)日：2015-09-10

申请号：US14198254

申请日：2014-03-05

Applicant: Concurix Corporation

Inventor： Bryce B. BARIL ,  Alexander G. GOUNARES ,  Russell S. KRAJEC

IPC: G06F11/36

CPC classification number: G06F11/3688 ,  G06F11/3616

Abstract: N-grams of input streams or functions executed by an application may be analyzed to identify security breaches or other anomalous behavior. A histogram of n-grams representing sequences of executed functions or input streams may be generated through baseline testing or production use. An alerting system may compare real time n-gram observations to the histogram of n-grams to identify security breaches or other changes in application behavior that may be anomalous. An alert may be generated that identifies the anomalous behavior. The alerting system may be trained using known good datasets and may identify deviations as bad behavior. The alerting system may be trained using known bad datasets and may identify matching behavior as bad behavior.

Abstract translation: 可以分析由应用程序执行的输入流或功能的N克，以识别安全漏洞或其他异常行为。 可以通过基线测试或生产使用来生成表示执行功能或输入流的序列的n-gram直方图。 警报系统可以将实时n-gram观察值与n-gram的直方图进行比较，以识别可能是异常的安全漏洞或应用程序行为的其他变化。 可能会产生识别异常行为的警报。 可以使用已知的良好数据集来训练警报系统，并且可以将偏差识别为不良行为。 可以使用已知的不良数据集来训练警报系统，并且可以将匹配行为识别为不良行为。

公开(公告)号：US20150254161A1

公开(公告)日：2015-09-10

申请号：US14198284

申请日：2014-03-05

Applicant: Concurix Corporation

Inventor： Bryce B. BARIL ,  Alexander G. GOUNARES ,  Russell S. KRAJEC

IPC: G06F11/36 ,  G06F11/34

CPC classification number: G06F11/3616 ,  G06F11/3409 ,  G06F11/3428 ,  G06F11/3447 ,  G06F11/3452 ,  G06F11/3466 ,  G06F2201/865

Abstract: Comparisons of different versions of an application may be compared using a behavior model of the application. A behavior model may be derived from n-gram analysis of observations of the application in production. The behavior model may include sequences of inputs received by the application or functions performed by the application, where each sequence is an n-gram observed in tracer data. Each n-gram may be coupled with a resource consumption to give a behavior model with performance data. A regression analysis may apply a behavior model derived from a first version of an application to the performance observations of a new version to create an expected performance metric for the new version. A similarly calculated metric from a previous version may be compared to the metric from a new version to determine an improvement or degradation of performance.

Abstract translation: 可以使用应用程序的行为模型来比较应用程序的不同版本的比较。 行为模型可以从生产中应用的观察结果的n-gram分析中得出。 行为模型可以包括由应用程序接收的输入序列或由应用程序执行的功能，其中每个序列是在跟踪器数据中观察到的n-gram。 每个n-gram可以与资源消耗相结合，以给出具有性能数据的行为模型。 回归分析可以将来自应用程序的第一版本的行为模型应用于新版本的性能观察，以创建新版本的预期性能指标。 可以将来自先前版本的类似计算的度量与来自新版本的度量进行比较，以确定性能的改善或降级。

公开(公告)号：US20150254151A1

公开(公告)日：2015-09-10

申请号：US14198239

申请日：2014-03-05

Applicant: Concurix Corporation

Inventor： Bryce B. BARIL ,  Alexander G. GOUNARES ,  Russell S. KRAJEC

IPC: G06F11/30 ,  G06F11/34

CPC classification number: G06F11/3003 ,  G06F11/3082 ,  G06F21/577 ,  G06F2201/865

Abstract: Input sequence information may be analyzed and quantified using n-gram analysis of inputs received by an application. The sequences of inputs may be represented by n-grams, and the frequency of the various n-grams may indicate the ‘real world’ uses of the application in production, which may be compared to a test suite whose coverage may be quantified using a similar n-gram analysis. A coverage factor may compare the observed inputs to the application in production to the test suite for the application. The n-grams may be further quantified or prioritized by resource utilization and several visualizations may be generated from the data.

Abstract translation: 可以使用应用程序接收的输入的n-gram分析来分析和量化输入序列信息。 输入序列可以用n-gram表示，并且各种n-gram的频率可以指示应用在生产中的“真实世界”使用，其可以与其覆盖可以使用 类似的n-gram分析。 覆盖因子可将观察到的输入与生产中的应用程序相比较，以应用于测试套件。 可以通过资源利用进一步量化或优先确定n克，并且可以从数据生成多个可视化。

公开(公告)号：US20150242303A1

公开(公告)日：2015-08-27

申请号：US14629322

申请日：2015-02-23

Applicant: Concurix Corporation

Inventor： Renat GAUTALLIN ,  Alexander G. GOUNARES ,  Christopher W. FRASER

IPC: G06F11/36

CPC classification number: G06F11/3636 ,  G06F11/3003 ,  G06F11/3082 ,  G06F11/3093 ,  G06F11/323 ,  G06F11/3466 ,  G06F2201/865

Abstract: A tracing system may be updated to include, exclude, or modify tracing configurations for functions based on how a user consumes tracing results. The user's interactions with graphical representations, inspections of data, and other interactions may indicate which functions may be interesting and which functions may not be. The user's interactions may be classified by use, such as during debugging, performance testing, and ongoing monitoring, and multiple user's interactions with the same function, library, module, source code file, or other groups of functions may be combined to predict a user's interest in a function.

Abstract translation: 可以根据用户如何使用跟踪结果来更新跟踪系统以包括，排除或修改功能的跟踪配置。 用户与图形表示，数据检查和其他交互的交互可以指示哪些功能可能是有趣的，哪些功能可能不是。 用户的交互可以通过使用进行分类，例如在调试，性能测试和持续监控期间，可以组合多个用户与相同功能，库，模块，源代码文件或其他功能组的交互来预测用户的 对功能的兴趣