Additional Test Levels applicable for Mobile Applications
In addition to the usual levels of testing from component through to acceptance testing, there is also a need for additional test levels for mobile application testing.
Some mobile applications need field testing to ensure that they function correctly in the expected usage scenario of real users. This could include testing on various networks and on different types of communication technologies such as Wi-Fi or cellular data.
Field tests should include the use of mobile towers, networks, Wi-Fi, and cellular data switching while the app is in use. Tests should be performed with varying download speeds and signal strengths, and include the handling of blind spots.
Field testing requires careful planning and the identification of all items required to perform the tests, such as appropriate device types, Wi-Fi, cellular data plans on various carriers and access to various modes of transport required to give adequate coverage. In addition, the routes and modes of transport, and the time of the day when the tests are to be executed need to be scheduled.
Usability of an app is another important aspect that needs to be covered while conducting field testing.
Tests should incorporate environmental factors such as temperature and similar conditions related to usage scenario.
Testing for Application Store Approval and Post-release Testing
Before an app is sent for publishing some checklist/based tests must be passed to assure the approval of the application stores. If the release is an upgrade, then upgrade related tests should also be run.
Checklists are typically based on guidelines, such as those specific to operating systems, for user interface design, and for using the libraries and APIs provided by application stores.
The approval process may take some time after submission. If any issues are found during the approval process, a new version may need to be submitted, which will require additional time to resolve. This situation requires careful consideration during project planning and testing.
A further level of testing is “post-release” testing. Testing at this level includes downloading and installing the application from application stores.