Test Execution - Reference pages
Global Test Execution Reference
Test Execution - Properties
The table below contains all properties and contained data of a test execution.
The properties of a test plan execution and a single test execution are identical except that a test plan execution can contain multiple tests while a single test execution contains exactly one test.
Name | The name identifies the execution together with a unique id. It's required and has to be set during creation of the execution. It can be edited later. The names of executions in the same project don't need to be unique. |
Description | An optional description for further explanation of the test execution. The description can be set during creation of the execution and can be edited later. |
Assignee | A user the test execution is assigned to. The assignee can be set during creation of the execution and can be edited later. |
Project | A project linked to the execution. Allows to link the execution to projects other than the corresponding project of the test / test plan. The corresponding project of the test / test plan is selected by default. The linked project can be set during creation of the execution and can be edited later. |
Component/s | One or more project components linked to the execution. |
Fix Version/s | On or more fix versions linked to the execution. |
Creation Date | The date and time the execution was created. The value of this property is automatically set after the execution was created and can't be changed. |
Start Date | The date and time the execution was first started. The value of this property is automatically set after the execution was started and can't be changed. |
Execution Date | The date and time the execution was completely finished. |
Status | The status of the execution. The value of this property is automatically set.
|
Tests | An execution contains all test of the test plan it was created on. In case of a single test execution it contains only the one test executed. The tests contained in the execution won't change although the corresponding test plan might be changed later. |
Test Steps | An execution contains all test steps that are part of the included tests at the time creating the execution. The test steps contained in the execution won't change although the definition of the corresponding tests might be changed later. |
Result & Status for each test / test step | An execution contains a status and a result description for each contained test and test step. These properties are further described in the Execution Runner and Statistics Reference. |
Test Execution - User interface
The execution view is one of the four main views in Test for JIRA.
After selecting a project in the plugin section you can navigate to the execution view by clicking the Execution button in the top right corner.
The execution view is divided into the following two sections:
Test Plan Executions
The test plan executions section displays all test plans of the selected project and all corresponding test executions in form of a table.
For every test plan the plan name is displayed and a small indicator comparing the amount of passed executions against the amount of failed executions for the test plan.
Hovering the mouse over the indicator displays the status, name and execution date of the completed executions.
If executions exist for a test plan that was later deleted, the test plan and its executions are still displayed in the test plan executions section.
The plan name of a deleted test plan is colored in grey.
For every test execution of a test plan the following properties are displayed:
- Execution Name
- Status
- The most recent date from creation date, start date and execution date
- The assignee of the execution
Single Test Executions
The single test executions section displays all tests of the selected project that have at least one single test execution.
The section displays only tests created on the selected project.
The definition tree of the selected project might contain tests created on different projects. These tests would be displayed in the execution view of the project they were created on.
Executions displayed in the section don't necessarily have to be created from the definition tree of the selected project.
If single executions exist for a test that was later deleted neither the test nor its previous executions will be displayed.
For every test the issue key and summary is displayed.
For every single test execution of a test the following properties are displayed:
- Execution Name
- Status
- The most recent date from creation date, start date and execution date
- The assignee of the execution
Test Execution - Operations
The test execution view provides the same operations for both test plan executions and single test executions.
Add execution
Click on the Add Execution next to the name of a test plan to open the add execution dialog.
Obviously the button is only visible for existing test plans.
Within the dialog you can enter the values for the following properties:
- Name
- Description
- Assignee
- Project
- Components
- Fix Versions
Click Create to create the execution so it can be run later.
You can also create and instantly run an execution by clicking Execute.
Run/Continue execution
Click on the next to an execution you want to run or continue.
The icon is only visible for executions that aren't already finished.
Clicking the icon opens the test execution runner with the last saved state of the selected execution.
Display execution statistics
Click on the next to an execution to display the corresponding execution statistics.
Note that statistics are also available for test executions currently in progress.
Edit the metadata of an execution
Click on the next to an execution to open the edit execution dialog.
The dialog allows you to edit the same properties that can be set during creation of a test execution.
Note that you can only edit the metadata of an execution.
The status of a test or test step can't be changed after it has been set.
Delete execution
Click on the next to an execution to open the delete execution dialog.
Deleting the only execution of a deleted test plan will also remove the test plan test plan executions table.
Deleting the only execution of a single test will also remove the test from the single test executions table.
Test Execution - Filter
Click on the Filter button to open the filter input.
Select one or more filter options and click Filter to apply the filter. An orange warning symbol next to the Test Plan Executions header indicates that a filter is applied.
Click on Clear to remove the current filter and close the input.
Click on Cancel to close the input without changing the current filter settings.
There are different filter settings that affect either the displayed test plan executions or the single test executions or both sections.
The different settings and the affected section/s are documented in the table below:
Affected section: | test plan executions | single test executions | |
Hide Plan Executions | Hides all test plan executions. Disables the "Plan Name" option. | ||
Hide Single Test Executions | Hides all single test executions. Disables the "Issue Summary" option. | ||
Plan Name | Displays only test plans in the test plan execution section containing the provided query in their names. | ||
Issue Summary | Displays only tests in the single test execution section containing the provided query in their issue summary. | ||
Execution Name | Displays only executions containing the provided query in their execution name. | ||
Status | Displays only executions with the selected status. | ||
Assignee | Displays only executions with the selected assignee. | ||
Project | Displays only executions having the project property set to the selected project. | ||
Component/s | Displays only executions having the component/s property set to the selected component/s. Works only in combination with the project option. | ||
Fix Version/s | Displays only executions having the fixed version/s property set tot the selected fix version/s. | ||
Execution From Date | Displays only executions created after the selected date. | ||
Execution To Data | Displays only executions created before the selected date. |
Test Execution - Export
Click on the Export button to open the export menu.
Select an export format for the group of executions you want to export from the list.
You can choose between exporting
- all test plan executions
- all single test executions
- execution details for the latest test execution
The executions can be exported as XML or Excel file.
The following tables describe the export content in each format for the three execution groups.
Export formats and content
Test plan executions
Export format | Content |
XML | The resulting file contains detailed information about every test plan execution including executions of deleted plans. It also contains detailed information about the corresponding test plan for every execution included. The XML export also provides information such as item ids that can be used to integrate another application with T4J via its REST API. |
Excel | The resulting file contains the name of the project and information about all test plan executions including executions of deleted test plans.
|
Single test executions
Export format | Content |
XML | The resulting file contains the same information about every execution that it does when exporting test plan executions. Instead of information about test plans the file contains detailed information about the corresponding test for every execution included. |
Excel | The resulting file contains the name of the project and information about all single test executions for tests of this project.
|
Last execution details
Export format | Content |
XML | The resulting file contains detailed information about every test plan including deleted plans and their last execution. This result is similar to the content when exporting test plan executions or single test executions but additionally it contains detailed information about the tests of each execution. |
Excel | The resulting file contains the names of all test plans including deleted plans and detailed information about the last execution for each plan.
|