If you have Duette installed, automated tests can easily be added to the script library. To add an automated test to your library:
Right click on your script package and select Add Automated Test.
You can also simply click on the automated test icon on the navigator tool bar.
You can also create a script for the automated test from the Script Library summary screens:
The Edit Automated Test Screen will open. Here you can add the Name of the script, assign it to a user and select the type of automated test. Once these fields are completed, the Default Path field will open. In this field, the path to the automated test tool results in your file system can be specified.
Additionally, if you select Unit Test Results, a Sub-Type field will be displayed where you can select the type of Unit Tests required to be imported. If you select a Custom Sub-Type you must provide the path to a valid XSLT file.
Similarly to manual test scripts, you can view all relationships associated to the script from the Relationships tab which displays all associated requirements and execution sets.
When all details have been completed, click Save and Close. The Automated Test Script will now be listed in the Script Library.
Below is the documented structure of a typical JUnit XML report. Notice that a report can contain 1 or more test suite. Each test suite has a set of properties (recording environment information). Each test suite also contains 1 or more test case and each test case will either contain a skipped, failure or error node if the test did not pass. If the test case has passed, then it will not contain any nodes. For more details of which attributes are valid for each node please consult the following section “Schema”.
<testsuites> => the aggregated result of all junit testfiles
<testsuite> => the output from a single TestSuite
<properties> => the defined properties at test execution
<property> => name/value pair for a single property
<error></error> => optional information, in place of a test case - normally if the tests in the suite could not be found etc.
<testcase> => the results from executing a test method
<system-out> => data written to System.out during the test run
<system-err> => data written to System.err during the test run
<skipped/> => test was skipped
<failure> => test failed
<error> => test encountered an error
The JUnit XML Report output comes from a build tool called Nant, as opposed to the JUnit project itself – thus it can be a little tricky to nail down an official spec for the format, even though it’s widely adopted and used. There have been a number of attempts to codify the schema, first off there is an XSD for JUnit:
This can be useful if attempting to do anything “tricky” with JUnit output where you need to confirm it’s compliant.
Stack Overflow Discussions
Here are some additional topics on stack overflow that discuss the JUnit XML format which can be useful for learning about the schema for the JUnit XML results format, as well to get hints about what minimum subset is normally suitable for most tools such as Jenkins (the same rules apply to ET generally as well).
To view the automation results that were most recently imported you can either double click on the run in the execution set grid or right click on the automated script in the execution set on the Explorer tab in the Tree view navigator and select View Automated Test Assignment.
The Automated Test Results screen will open and default to the Summary tab.
The following tabs are available:
The Summary tab lists all import information. This information is sourced from the imported automated test results and also from the information the user has entered when importing these scripts into Enterprise Tester. The Summary tab provides two charting widgets showing the Run Status Over Time and Status Group by Day ( widget is configurable and you can select the field or the date parameter to chart against).
The Summary tab also provides a summary grid of all run results for this automated test script assignment. Similar to other summary screen grids, the run history grid is configurable. You can select the columns to display or filter the results using TQL.
The Results tab provides a tree view of the results of your automated test run. You can drill down to the detail in each node. In the top right corner is a status filter where you can select on the status that you want to be displayed e.g. only failed and warnings. This will allow you to quickly filter your results set to only the relevant statuses for review.
Each node has an icon indicating results:
Users can add attachments, add and link incidents and view the node details via the screen.
If a user clicks node details a Result Node screen is displayed with the following tabs: All of this information is sourced from the automated test tool itself.
Details – high level information relating to the specific results node. You can add notes on your results node which will display in the Results tree view in the Notes column.
Parameters – automated tool parameters.
Metadata – any metadata utilized in the automated scripts.
Test Data Tab
The Test Data tab displays table driven variable information from the automated test tool. Currently this function will only be displayed for imported QTP data.
Attachments and Relationships Tabs
The Attachments and Relationships tabs have been implemented in a consistent way with other areas of Enterprise Tester:
Attachments can be added when required from the Attachments link.
Any relationships to the automated test, such as incidents, can also be viewed.
To import automated test results, like manual tests, In the script library you first need to add an automated test script. This is not the script that your automated tool will run. It is a placeholder in the Script Library for your Automated Test that specifies the type of results and the pathway to the results to import.
To do this, from the Explorer tab in the tree view navigator, click to select the package you wish to add your automated test script to.
Then either click on the Add Automated Test icon from the menu bar.
Or right click on the Package and select Add Automated Test.
The New Automated Test screen will appear. Complete the details:
Enter a name for your test.
Enter the User name of the person assigned to the Automated Test.
Select the test type from the drop down list. HP Quick Test Professional, IBM Rational Functional Tester,Selenium or Unit Test Results
Only applicable for Unit Test Results. Select from the dropdown list the type of results you are importing
Enter the path to a specific results file or folder. This is not required. When importing results you can manually select the file to upload.
Once the Automated Test Script is created, you then need to add it to your execution set by dragging and dropping from the script library to the execution set package or by using the Create Execution button on the grid tool bar.
To import the results, right click on the Automated Test Assignment in the execution set and select Import Result from the menu or double click on the Automated Test Assignment in the execution set grid to open the script assignment.
A dialogue box will appear that displays the following two tabs:
Import from path – If you setup a default path in the Automated Test setup in the script library this will be displayed in the Results Path field. If the default path is still correct, enter your automated test results file name and click Import.
Upload file – You can select to upload your file.
Progress information will be displayed followed by the Success message.
Duette is the automated testing tool plugin for Enterprise Tester. It enables users to import results from automated testing tools into Enterprise Tester. All testing results, manual and automated can be managed from Enterprise Tester giving users full visibility of testing status and progress.
Licensing of Duette is separate from your Enterprise Tester License. To run Duette, a current license of Enterprise Tester and Duette are required. If your Duette license expires, you will still be able to view, move and rename automated tests that you have previously imported using Duette, but you will no longer be able to create new automated tests, automated test assignments or import new runs.
Automated Testing Tools Supported
Enterprise Tester’s automated testing plugin, Duette, supports importing results from the following tools:
IBM Rational Functional Tester – 8.1 and 8.2 HTML Output
HP Quick Test Professional – 10 and 11 Output
Selenium HTML Suite
Unit Test Results
Custom results using XSLT data ( transforms Custom XML to J-Unit)
Microsoft MS Test
To allow automated test results to be imported you must have dragged and dropped your Automated Script from the Script Library into an execution set, as noted previously in this document.
As each automated test within your automated test tool is repeated you can import new results into the same execution set script. All results are recorded and a run history is available for each imported set of results.
You can choose to manually import your results either by uploading results or setting an automated import schedule.
Note: Duette requires current licenses for both Duette and Enterprise Tester to create new automated tests, automated test assignments or import new runs.
See the User Guide