Test Execution - Reference
Overview
A test execution provides documentation of a test run. This includes the test cases, their test steps and the corresponding status and results, as well as additional information such as the time of execution and various statistics. Explained below are the attributes of test executions, the views in which they are managed, the criteria available for filtering executions, and information about exporting executions in different formats.
Test Execution Attributes
Name | The name identifies the test execution, which is set during creation of the execution, but can be changed at any time. The names of executions do not need to be unique. |
Description | An optional description to document the test execution. |
Assignee | The user to which the test execution is assigned. |
Project | A project linked to the test execution. This is by default the project in which the execution is created, but a different project can be selected. The execution belongs to the project in which it is created, regardless of the selected project. |
Component/s | One or more project components from the linked project. |
Fix Version/s | One or more fix versions from the linked project. |
Creation Date | The date and time the test execution is created. These are automatically set during creation and cannot be changed. |
Start Date | The date and time the test execution is first started. This is automatically set at the start of the execution and cannot be changed. |
Execution Date | The date and time the test execution is completely finished. This is automatically set at the end of the execution and cannot be changed. |
Status | The status of the test execution. This is automatically set with the following values:
|
Tests | The test cases included in the test execution, which depends on the type of the execution:
The execution’s test cases never change even if the test cases in the corresponding test plan are subsequently changed. |
Test Steps | The test steps included in the test execution’s test cases. The execution’s test steps never change even if the test steps in the corresponding test cases are subsequently changed. |
Result & Status | A test execution includes a status and a result description for each included test case and test step. |
Test Execution Views
View | Purpose |
---|---|
Execution View | The Execution View displays the various executions of test plans in a project. It is reached by selecting the Execution button in the set of R4J menus. The Execution View is split into two tables, one organized by test plan executions and the other by single test case executions. Various attributes of executions are displayed: test plan name, execution name, status, date of execution, assignee. In the case of test plan executions, a “last executions” bar shows the proportion of successful versus failed executions of the test plan. |
Plan View | The Plan View is a closely related view that lists the test plans belonging to a project. It is reached by selecting the Plan button in the set of R4J menus. For details see Test Plans. |
Test Execution Operations
See Test Execution - How-to Guide.
Test Execution Filter Criteria
Criteria | Purpose |
---|---|
Hide Plan Executions | Hide all test plan executions. Disables the "Plan Name" option. |
Hide Single Test Executions | Hide all single test case executions. Disables the "Issue Summary" option. |
Plan Name | Display executions in the test plan execution section whose plan name matches the provided string. |
Issue Summary | Display executions in the single test execution section whose issue summary matches the provided string. |
Execution Name | Display executions whose name matches the provided string. |
Status | Display executions with the selected status. |
Assignee | Display executions with the selected assignee. |
Project | Display executions linked to the selected project. |
Component/s | Display executions with the selected component/s in the linked projects. |
Fix Version/s | Display executions with the fixed version/s property set totthe selected fix version/s in the linked projects. |
Execution From Date | Display executions created after the selected date. |
Execution To Data | Display executions created before the selected date. |
Test Execution Export
Test plan executions
Export format | Content |
XML | The resulting file contains detailed information about test plan executions (including executions of deleted plans), as well as detailed information about the corresponding test plans. The export also provides item IDs that can be used to integrate another application via the T4J REST API. |
Excel | The resulting file contains information about test plan executions (including executions of deleted test plans). For each execution there is a row with the following columns:
|
Single test case executions
Export format | Content |
XML | The resulting file contains detailed information about test plan executions. The export also provides item IDs that can be used to integrate another application with via the T4J REST API. |
Excel | The resulting file contains information about single test case executions. For each execution there is a row with the following columns:
|
Last execution details
Export format | Content |
XML | The resulting file contains detailed information about the test cases and test tests of the last executions of test plans (including executions of deleted plans). The export also provides item IDs that can be used to integrate another application with via the T4J REST API. |
Excel | The resulting file contains the names of test plans (including executions of deleted plans) and detailed information about the last execution for each plan, as follows:
|
Examples of XML exports
Test plan execution
<?xml version="1.0" encoding="UTF-8"?>
<executions>
<projectName>PROJECT</projectName>
<execution>
<result>
<id>47</id>
<name>Example test execution</name>
<description>An example test execution</description>
<deleted>false</deleted>
<assignee>admin</assignee>
<passed>true</passed>
<failed>false</failed>
<running>false</running>
<notrun>false</notrun>
<created>2016-10-27T12:44:24.050+02:00</created>
<started>2016-10-27T12:56:00.777+02:00</started>
<finished>2016-10-27T12:56:00.777+02:00</finished>
</result>
<plan>
<prjKey>PRJ</prjKey>
<project>10100</project>
<description/>
<configuration>0</configuration>
<id>81</id>
<name>Example plan</name>
<copying>false</copying>
<copyFailed>false</copyFailed>
<testCount>2</testCount>
<stepCount>2</stepCount>
</plan>
</execution>
<execution>
<result>
<id>48</id>
<name>Example execution 2</name>
<description/>
<deleted>false</deleted>
<assignee>admin</assignee>
<passed>true</passed>
<failed>false</failed>
<running>false</running>
<notrun>false</notrun>
<created>2016-10-27T12:57:17.250+02:00</created>
<started>2016-10-27T12:57:26.290+02:00</started>
<finished>2016-10-27T12:57:28.273+02:00</finished>
</result>
<result>
<id>46</id>
<name>Another execution of the same test plan</name>
<description/>
<deleted>false</deleted>
<assignee>admin</assignee>
<passed>true</passed>
<failed>false</failed>
<running>false</running>
<notrun>false</notrun>
<created>2016-10-26T15:06:01.997+02:00</created>
<started>2016-10-26T15:06:12.793+02:00</started>
<finished>2016-10-26T15:06:29.680+02:00</finished>
</result>
<plan>
<prjKey>PRJ</prjKey>
<project>10400</project>
<description>Another example testplan</description>
<configuration>1</configuration>
<id>76</id>
<name>Example Plan 2</name>
<copying>false</copying>
<copyFailed>false</copyFailed>
<testCount>3</testCount>
<stepCount>2</stepCount>
</plan>
</execution>
</executions>
Single test case execution
<?xml version="1.0" encoding="UTF-8"?>
<executions>
<projectName>PROJECT</projectName>
<execution>
<result>
<id>48</id>
<name>Example single test execution</name>
<description/>
<deleted>false</deleted>
<assignee>admin</assignee>
<passed>false</passed>
<failed>false</failed>
<running>false</running>
<notrun>true</notrun>
<created>2016-10-27T12:46:37.417+02:00</created>
</result>
<result>
<id>34</id>
<name>Another single test execution</name>
<description/>
<deleted>false</deleted>
<assignee>admin</assignee>
<passed>true</passed>
<failed>false</failed>
<running>false</running>
<notrun>false</notrun>
<created>2016-10-20T16:02:01.193+02:00</created>
<started>2016-10-20T16:02:03.393+02:00</started>
<finished>2016-10-20T16:02:03.393+02:00</finished>
</result>
<single>
<issueKey>PRJ-20</issueKey>
<issueSummary>Example test</issueSummary>
<issueUrl>http://host:port/jira/browse/PRJ-20</issueUrl>
</single>
</execution>
</executions>
Last execution details
<?xml version="1.0" encoding="UTF-8"?>
<executions>
<projectName>PRJ</projectName>
<execution>
<result>
<id>47</id>
<name>Example test execution</name>
<description>An example test execution</description>
<deleted>false</deleted>
<assignee>Admin</assignee>
<passed>true</passed>
<failed>false</failed>
<running>false</running>
<notrun>false</notrun>
<created>2016-10-27T12:44:24.050+02:00</created>
<started>2016-10-27T12:56:00.777+02:00</started>
<finished>2016-10-27T12:56:00.777+02:00</finished>
<tests>
<name>Example Test</name>
<description>An example test</description>
<descriptionRendered><p>An example test</p></descriptionRendered>
<failureMessage/>
<folders>Example Folder</folders>
<folders>Subfolder</folders>
<failed>false</failed>
<passed>true</passed>
<notrun>false</notrun>
<skipped>false</skipped>
<steps>
<name>Example test step</name>
<description>An example test step</description>
<failureMessage/>
<failed>false</failed>
<passed>true</passed>
<notrun>false</notrun>
<skipped>false</skipped>
<expectedResult>-</expectedResult>
<run>2016-10-27T12:56:00.777+02:00</run>
<id>537</id>
<parameters>
<key>p1</key>
<identifier>##p1##</identifier>
<value>parameter value</value>
</parameters>
<originalDescription>An example test step</originalDescription>
<executedBy>Admin</executedBy>
<executedByUrl>http://host:port/jira/secure/ViewProfile.jspa?name=admin</executedByUrl>
</steps>
<finished>2016-10-27T12:56:00.777+02:00</finished>
<id>197</id>
<executedBy>Admin</executedBy>
<executedByUrl>http://host:port/jira/secure/ViewProfile.jspa?name=admin</executedByUrl>
<issueUrl>http://host:port/jira/browse/PRJ-20</issueUrl>
<issueKey>PRJ-20</issueKey>
<issueStatus>To Do</issueStatus>
<issueType>New Feature</issueType>
</tests>
</result>
<plan>
<prjKey>PRJ</prjKey>
<project>10400</project>
<description/>
<configuration>0</configuration>
<id>81</id>
<name>Example test plan</name>
<copying>false</copying>
<copyFailed>false</copyFailed>
<testCount>2</testCount>
<stepCount>2</stepCount>
</plan>
</execution>
</executions>