Test Coverage - How-to Guide

Overview

The major tasks for managing test coverage views in T4J are explained in the sections below. To work on a coverage view, the first step is to navigate to it, as follows:

  • Select the project to open, using one of the following ways:

    • Select Tests in the main navigation bar and select a project from Current Project or Recent Projects.

    • Select Tests > View all projects from the main navigation bar and select a project from the list.

    • You should now see the definition view, which is the default view of a project.

  • Select the Coverage entry in the main T4J menu. You should now see the Coverage View, which displays the name of the active view followed by a list of existing views in the left panel. The views are organized into two lists:

    • Personal views, which only the user who created them can access.

    • Public views, which have been shared with others.

  • To work on a specific view, select the name of the view in the left panel.

Coverage View Tasks

Task

Action

Task

Action

Create Coverage View

  • If there is no active coverage view, select the button “Select Source Items”. If a coverage view is displayed, first select the button “Clear All” and then select “Select Source Items”.

  • Provide the information in the dialog “Select Source Items” - see task “Specify Coverage Level”.

  • Select “Save View As” in the left column, providing a name for the view and specifying whether the view is for your use only (private) or shared with others (public).

Add Coverage Level

  • Select the button “Add Coverage Level”.

  • Provide the information in the dialog “Add Coverage Level” - see task “Specify Coverage Level”.

  • Select “Save View” in the left panel.

Edit Coverage Level

  • Select the Edit icon in the header of a column.

  • Provide the information in the dialog “Update Coverage Level” or “Update Source Items” - see task “Specify Coverage Level”.

  • Select “Save View” in the left panel.

Remove Coverage Level

  • Select the Remove icon in the header of a column. The view is immediately removed, without confirmation.

Specify Coverage Level

The dialogs “Select Source Items”, “Update Source Items”, “Add Coverage Level” and “Update Coverage Level” are used to specify the contents of a coverage level column, according to the following information:

  • Label: The title of the column.

  • Source: Select one of the following options to determine how the issues in the column are to be identified. The input field above this item changes to reflect the choice of option.

    • Issue Types - You will specify one or more issue types in the input field.

    • Filter - You will select the name of a saved Jira query in the input field.

    • JQL - You will provide an expression in the Jira Query Language in the input field.

  • Link Types: In the case of the “Add Coverage Level” and “Update Coverage Level” dialogs, this additional option is displayed, in which you specify the link types that are used to determine the relationship between issues in the column and issues in the preceding column. See section How to Specify Link Types for more about this.

  • Test Executions: If the issues in the column are test cases with test executions, select this option to add an extra column showing recent test executions of the cases. You can specify the number of executions to be shown.

  • Project Name: By default, related test executions can be in any project, but you can limit this by specifying one or more projects here. Note that the projects specified here have nothing to do with projects of the issues to be included in the column being defined.

Refresh Coverage View

  • Select the button “Refresh” to rerun all queries and bring the view up to date with Jira.

Determine Display Fields

  • Select the button “Display Fields” to add additional fields to the information displayed about each issue.

Export Coverage View

  • Select the button “Export” and choose the option “XML” or “Excel” to determine the export format.

Copy Coverage View

  • Select Save View as from “…” next to the name of the active view. Provide a name for the new view and choose whether it is private or public.

Rename Coverage View

  • Select Rename using the triangle next to the name of a view and provide a new name for the view.

Delete Coverage View

  • Select Delete using the triangle next to the name of a view.

  • Select Get URL using the triangle next to the name of a view. The resulting link can be shared with someone via email.

How to Specify Link Types

Issues may be related to each other in various ways, using different so-called “link types” in Jira. A link type relates two issues, A and B, and has two directions, A → B and B → A. If the intention is that the relation is not symmetrical, the directions have different so-called “inward” and “outward” descriptions in Jira.

In the following example, we assume that you link requirements to test cases with the link type “Test” and the direction from requirement to test case (called “inward”) is described as “is tested by” and the direction from test case to requirement (called “outward”) is described as “tests”. That is, a given requirement is tested by a given test case, while the test case tests the requirement.

Now if the first column in your table is for customer requirements and the next column is for test cases, then you would specify the description “is tested by” in order to exclude other kinds of links that might exist between the issues.

Notice that the description of the link type is determined from the point of view of issues in the first column and is the so-called “inward description” of the link type. In this example, the “outward” description of the link type (“tests”) would be the wrong name to specify.