Test Coverage

AIMS QGIS Plugin UI Testing Coverage

There are many terms and definitions that are used to describe a wide range of software testing methods and levels. This wiki page provides some guidance to the testing levels used in the Roads DB.

Testing Levels

Unit Tests

• Test verifies the implementation of code
• If any dependancies exist they are typically mocked (scaffolding)
• Mostly used by developers

Integration Tests

• The test verifies implementation of individual components and their interconnection behaviour when they are used together
• A failed test can mean that the code is still correct but the environment has changed
• External dependancies are typically mocked (scaffolding)
• Mostly used by developers and testers
• It starts from the interface specification
• The 'grain' of integration tests can range from the smallest function group up to the whole solution

System Tests

• The functions of the system are tested to ensure that for the given inputs the correct outputs are produced
• A failed test can mean that the requirements or the implementation of the requirements are not correct
• Dependancies are not mocked
• Mostly used by testers
• It starts from the requirements specifications

User Acceptance Tests

• The system is tested to ensure it performs the business processes required
• A failed test case can mean that a feature or functionality has not been implemented
• Mostly used by users

Smoke Tests

• The test checks the basic operation of the system
• The test does not typically modify data
• Mostly used by operations
• consists of minimal attempts to operate the software, designed to determine whether there are any basic problems that will prevent it from working at all.

AIMS 'UI Testing'

This set of tests are run by the test team and consist of approx 300 tests. The tests cover all the system functions, can be traced back to the Functional Requirements and cover both System and User Acceptance Testing. The test documentation is kept by LINZ in a spreadsheet.

Function	Module	System Tests
Address Prefix	Add	4
Address Type	Add	3
Addressable Object Id	Add	1
Alpha	Add	4
Base	Add	6
Comments	Add	1
Ext Address Id Scheme	Add	1
External Address Id	Add	1
High	Add	6
Level Type	Add	2
Level Value	Add	2
Life Cycle	Add	4
Locality	Add	2
Meshblock Override	Add	11
Object Name	Add	1
Position	Add	1
Position Type	Add	1
Reference Data	Add	1
Road Centreline	Add	5
Road Name	Add	12
Road Suffix	Add	6
Road Type	Add	4
Stack	Add	1
Towncity	Add	1
Uniqueness	Add	2
Unit Type	Add	2
Unit Value	Add	6
Usability	Add	4
Water Name	Add	1
Water Route Name	Add	1
	Add	1
	Groups Resolution	5
Search	Map	10
Usability	Map	8
Locality	Move	1
Position	Move	1
Stack	Move	3
Towncity	Move	1
Usability	Plugin Button	1
Accept	Resolution	5
Display	Resolution	5
Reject	Resolution	3
Usability	Resolution	2
Life Cycle	Retire	3
Address Prefix	Update	3
Address Type	Update	6
Alpha	Update	3
Base	Update	5
Comments	Update	1
Ext Address Id Scheme	Update	1
External address Id	Update	1
High	Update	4
Level Type	Update	2
Level Value	Update	3
Life Cycle	Update	2
Locality	Update	2
Meshblock Override	Update	7
Object Name	Update	3
Object Type	Update	2
Position Type	Update	2
Road Centreline	Update	1
Road Name	Update	7
Road Suffix	Update	4
Road Type	Update	2
Stack	Update	1
Uniqueness	Update	2
Unit Type	Update	2
Unit value	Update	6
Usability	Update	1
Water Name	Update	1
Water Route Name	Update	1
	Update	1
Address Prefix	Update resolution	3
Address Type	Update resolution	7
Alpha	Update resolution	3
Base	Update resolution	5
Comments	Update resolution	3
Ext Address Id Scheme	Update resolution	1
External Address Id	Update resolution	1
High	Update resolution	4
Level Type	Update resolution	2
Level Value	Update resolution	3
Life Cycle	Update resolution	3
Locality	Update resolution	3
Meshblock Override	Update resolution	7
Object Name	Update resolution	3
Object Type	Update resolution	2
Position Type	Update resolution	2
Road Centreline	Update resolution	1
Road Name	Update resolution	7
Road Suffix	Update resolution	4
Road Type	Update resolution	2
Towncity	Update resolution	1
Uniqueness	Update resolution	2
Unit Type	Update resolution	2
Unit Value	Update resolution	6
Usability	Update Resolution	2
Water Name	Update resolution	1
Water Route Name	Update resolution	1