iOS Application Testing
23 likes14,339 views
The document outlines various options for iOS app testing, highlighting three main categories: native iPhone applications, web-only content, and hybrid applications. It emphasizes the importance of testing on real devices rather than simulators, detailing several key testing scenarios that should be executed, such as usability, performance, and compatibility tests. Additionally, it introduces testing tools like Fonemonkey and Eggplant, which aid in automating the testing process and ensuring effective regression testing.
iOS Application Testing
- 2. What Are our Options? Before we decide how to present our product to iPhone OS users, we need to understand the range of options we have. Depending on the implementation details of our proposed product and its intended audience, some types of software may be better suited to our needs than others. This section divides software for iPhone OS–based devices into three broad categories, primarily based on implementation method. Roughly speaking, we can create: ■ An iPhone application, which is an application you develop using the iPhone SDK to run natively on iPhone OS–based devices. ■ Web-only content, including web applications, which are websites that behave like built-in iPhone applications. ■ A hybrid application, which is an iPhone application that provides access to web content primarily through a web-content viewing area, but includes some iPhone OS user interface elements.
- 3. App testing on a real device Vs a simulator There appears to be a few iPhone App simulators out there on the net claiming to offer solutions for beta testing an iPhone App. Well, although technically(and I use this term loosely) correct, the so called 'simulators' are nothing more than web browser screens made to be the same size an iPhone screen. This really cannot offer a real beta test of an application, can they? So what are the differences between testing on a simulator and a real device? The CPU type The screen (a real iphone has a touch-screen of course) Installing the App Memory usage Zooming functionality Network connectivity related issues Remember, customers that buy the App from the App store won't be running it on a simulator!
- 4. App Testing 1. Ensure the App will be tested on real devices (not simulators). 2. Check a range of devices is available, e.g. iPhone 3, iPhone 4, iPad and iPod Touch. 3. Make sure the testing will be carried out using the latest firmware available for that device. 4. Always ask an iPhone App Tester about Usability testing too. 5. Always ask for a test report.
- 5. High Level test scenarios for Iphone application Handset application functionality : perform real iPhone based testing of the application, with various scenarios. Test team will test the application based on defined specifications Device Certification : certify applications on actual device. Test team should test the performance of the application, resource usage, behavior and interactions Performance and Scalability: Backend applications will need to manage the traffic of multiple mobile devices at the same time. This test will identify all the load issues and will help make system more scalable Usability & Compatibility : verify the effectiveness of Usability of application onto various devices including interoperability with other applications running on the device. Certify the Application on Various mobile devices for the correct behavior and interactions
- 6. UI Response Application : verify the response of each function and measure the performance of each response. Settings response : verify all settings available for the application and test the functionality of each setting Crash Points: identify all crash points, and will work with development team to resolve them Low Connectivity: test the behavior of iPhone App in Low connectivity mode and verify proper behavior Response Memory Handling: measure the memory usage of the application and identify all memory leaks Sleep Mode : test the application response in the sleep mode Accelerometer: test to ensure that iPhone application properly responds to rotations Battery Usage : measure the battery usage and will provide feedback on increasing battery life Retrials in Case of network disconnect : test application behavior in case of network disconnect
- 7. Execution Build Acceptance Testing -The first test iPhone App Testers team performs after every code drop. Verifying that the application build is stable to be tested. High priority defect fixes – iPhone App Testers will verify after build acceptance suite execution is complete. General test case execution shall be priority based, where high priority test cases are executed first, followed by medium and low priority test cases. Regression Testing – iPhone App Testers will perform verification of application functionality to verify that new code did not break the existing functions and the system is not adversely affected by any code or configuration changes. Ad-Hoc – iPhone App Testers will conduct Testing where random actions are executed in an attempt to break the system. Such executions include (but are not limited to) inputting invalid values, malicious input, and unnatural navigation. iPhone Compatibility Testing- iPhone App Testers will test in the following OS/ Device combination: 2.0 2.2 2.2.1 3.X iPod Touch 1st gen X X iPod Touch 2nd gen X Edge X X 3G X X 3GS X
- 8. Test Method • iPhone App Testers team will manually test functionality based on the requirements in the test environment • iPhone App Testers team will analyze and record all test results • iPhone App Testers will use it’s own lab to conduct compatibility test • Defects found by iPhone App Testers during testing will be logged into the Bug Tracking Database • All fixed defects will be verified by iPhone App Testers
- 9. FoneMonkey: Iphone application functional test automation tool FoneMonkey is a functional testing tool for the iPhone providing for the interactive creation, editing and playback of automation scripts that exercise an application’s user interface. Using FoneMonkey, you can create suites of tests that automate performing user operation sequences and verifying results. FoneMonkey is designed to support developer as well as QA testing, and FoneMonkey tests can be easily incorporated into continuous integration environments. Features of FoneMonkeyTM Free and open source automation tool for iphone mobile application. This is World’s first iPhone functional testing tool Ability to record, edit, and playback user interface tests and fully automate iPhone app testing Designed to be used as a standalone, interactive recording and playback tool Using FoneMonkey, you can create suites of tests that automate performing user operation sequences and verifying results It is designed to support developer as well as QA testing, and FoneMonkey tests can be easily incorporated into continuous integration environments It is designed to provide developers with a tool to decrease development time through reduced regression risk and address management’s concerns about unforeseen costs resulting from inefficient, manual testing.
- 10. Automated Software Testing for the User Interface eggPlant is a low-overhead, non-invasive black-box test and process automation tool. Since it does not reside on the system-under-test and is technology agnostic, it can test in many situations that other tools cannot. By using image capture and advanced search techniques, most ui changes are not a problem.
- 11. Other Tools UIAutomation Instrument :http://developer.apple.com/technologies/iphone/whats- new.html#tools UISpec is a Behavior Driven Development framework for the iPhone that provides a full automated testing solution that drives the actual iPhone UI. It is modeled after the very popular RSpec for Ruby : http://code.google.com/p/uispec/ Google Toolbox for Mac : http://code.google.com/p/google-toolbox-for-mac/ Cucumber for iphone :http://www.slideshare.net/undees/iphone-meets-cucumber OCUnit:http://mobileorchard.com/ocunit-integrated-unit-testing-in-xcode/
- 12. Source : http://mobileappstesting.com/2010/02/24/346/ http://en.wordpress.com/tag/iphone-application-testing/ http://www.testplant.com/products/eggplant_functional_tester