Comparing Several Test Results

This tutorial describes how to compare two test results in NeoLoad and how to generate a comparison report.

To gain the most from this tutorial, it is recommended to have read the reference documentation beforehand.

Understanding the Context

NeoLoad provides the means of identifying potential performance bottlenecks in your application. This is mainly achieved by obtaining fine grained statistics on the different pages of the application. Through comparison you can analyze results from different runs of the same (or different) scenario(s). The steps typically involved in a testing phase are:

  1. Running a particular scenario

  2. Analyzing the results and identifying time consuming pages

  3. Changing and improving the pages, or the code called by those pages

  4. Re-running the scenario

  5. Comparing results before and after improvements

Comparing Results in the GUI

NeoLoad provides a compare mode within its graphical interface:

Procedure 16.12. Launching Compare mode

  1. Open the Results Manager from the "Edit / Results Manager" menu.

  2. In the table, select the two results to compare (click the first row, and 'Ctrl+click' the second row)

  3. Click on the "Compare" button.

  4. Edit the labels of the two tests and click "OK". The defaults are "A" and "B".

Comparing Results in Reports

NeoLoad can generate comparison reports:

Procedure 16.13. Generating a comparison report

  1. Open the Results Manager from the "Edit / Results Manager" menu.

  2. In the table, select the two results to compare (simple click for the first row, and 'Ctrl+click' for the second row)

  3. Click on the "Generate report" button.

  4. Edit the labels of the two tests and click "Next". The default labels are "A" and "B".

  5. Configure the format, the report's content and the report file's directory, then click "OK".