Automated test strategy is one the key factors of technical tests. Its visibility make the tests part of the development process.Without goals, roles, tools, requirements, scheduling… the automated tests are forgotten deep in the versioning system…
As written in the ISTQB Exam Certification:
The choice of test approaches or test strategy is one of the most powerful factor in the success of the test effort and the accuracy of the test plans and estimates. This factor is under the control of the testers and test leaders.
By describing, managing and tooling-up the different automated tests you will define your strategy.
This global strategy page gives main clues to manage your technical test strategy.
To have a relevant test strategy make it visible.
What is a test strategy?
A test strategy is an outline that describes the testing approach of the software development cycle. It is created to inform project managers, testers, and developers about some key issues of the testing process. This includes the testing objective, methods of testing new functions, total time and resources required for the project, and the testing environment.
Test strategies describe how the product risks of the stakeholders are mitigated at the test-level, which types of testing are to be performed, and which entry and exit criteria apply.
They are created based on development design. System design is primarily used and occasionally, conceptual design may be referred to. Design documents describe the functionality of the software to be enabled in the upcoming release. For every stage of development design, a corresponding test strategy should be created to test the new feature sets.
The test strategy describes the test level to be performed. There are primarily three levels of testing: unit testing, integration testing, and system testing as you can read in the Automated test classification.
In most software development organizations, individual testers or test teams are responsible for integration and system testing when dealing withfunctional behavior. Here we speak more of Acceptance tests or Functionnal tests (for example based on HP QC and executed with UFT (ex QTP).
The developers and test experts are responsible for automated tests on unit testing, integration testing, system testing.
The automated tests should first be classified in order to be used and integrated into a industrialized process. Please look at the test classification page: Automated test classification
Lack of test strategy issues
The common issues with automated tests are not associated to technical problems or the choices of tools, but resides especially in its non-visibility.
When the added value of technical tests is not visible, the organisation will give advantage on more « quantifiable tests » (like functional tests or performance tests) and give-up on technical ones (unit, integration…).
For example, the functional tests are easily quantifiable: dedicated “testing” teams, based on the requirements, test plan in QC, instrumentalisation by UFT (ex QTP) by VB script.
This way, it is easier to give budget to: handle, manage and implement functional tests.
Technical tests remain with the costs of the developers. Because very often, one will say the developers “will make the unit tests” but without real requirements or strategy.
Agile projects and using the BDD reverses this trend by bringing closer the Dev and Test teams. Especially when requiring the developers to implement the acceptance tests.
By making the technical tests part of the test strategy, we will improve their development requirements and make them more relevant.
Set up a test strategy
- Application coverage objectives
- Set-up a test maintenance plan
- Have a source code health feedback
- Use tests as delivery acceptation
- Verify features non-regression
- Maintain source code knowledge
Automated test strategy steps
|Define Scope and Technology||
|Define Test Approach||
Choose by what type of test starting
Use Test classification
What relevant coverage is expected ?
What test volume is expected ?
|Choose a test development methodology||
|Identify risks and mitigation||
|Define Test environment||
|Choose Testing tools||
|Define Execution and release control||
|Defect reporting and tracking||
|Set-up Reviews and updates||
- ISTQB Exam Certification on Test Strategy
- Agile Test Strategy Example Template
- Test strategy Wikipedia
- Software testing help
- BDD Guidelines and Best Practices
- Bach, James (1999). « Test Strategy » (PDF).