User Testing by Alvin Chai
2 likes3,116 views
This document summarizes a presentation about user testing. It discusses: 1. What user testing is and its purpose of measuring usability, task time, and user experience. 2. The two main ways of conducting user testing - in person and online. Online testing allows for faster turnaround, lower costs, and more natural testing than in-person. 3. Examples of case studies where online user testing helped improve websites and apps by identifying usability issues and determining the most engaging design. 4. The various stages in a product lifecycle where user testing provides value, such as during prototyping, development, and post-launch monitoring.
User Testing by Alvin Chai
- 1. User Testing Alvin Chai, Speaker UX Indonesia – Malaysia 2014, 26th April 2014
- 2. Copyright © 2014 Netizen Testing Sdn. Bhd. All rights reserved. All other trademarks, logos and copyrights are the property of their respective owners. 2 Topics To Be Covered Today 1. Introduction 2. Ways of Doing User Testing 3. Case Studies 4. When to Test 5. Demo
- 3. Copyright © 2014 Netizen Testing Sdn. Bhd. All rights reserved. All other trademarks, logos and copyrights are the property of their respective owners. 3 Introduction • What is user testing? source:static.pb.pl/picture/40479,40918/f663x450
- 4. Introduction • A method by which users are asked to perform certain tasks in an effort to measure the product’s user friendliness, task time, and how user feel about the usage experience. • Think Aloud!
- 5. Copyright © 2014 Netizen Testing Sdn. Bhd. All rights reserved. All other trademarks, logos and copyrights are the property of their respective owners. 5 User Testing For The Digital World Test websites/apps to find usability issues (where users are confused, why they are leaving)
- 6. UX Myth “YOU know a lot about your service & website, you are passionate about it.” “Your USER doesn’t necessarily care.” YOU are NOT your USER no matter how good you think you are
- 7. Copyright © 2014 Netizen Testing Sdn. Bhd. All rights reserved. All other trademarks, logos and copyrights are the property of their respective owners. 7 2 Ways of Doing Usability Testing
- 8. Copyright © 2014 Netizen Testing Sdn. Bhd. All rights reserved. All other trademarks, logos and copyrights are the property of their respective owners. 8 (i) In Person Testing 2 Ways of Usability Testing (ii) Online User Testing
- 9. Copyright © 2014 Netizen Testing Sdn. Bhd. All rights reserved. All other trademarks, logos and copyrights are the property of their respective owners. 11 1. Set up test questions 2. Look for participants 3. Arrange time to come in and availability of user and facilitator 4. Wait for everyone to finish 5. Collect test results 6. Analyse test results 7. Reporting (i) In Person Testing Cycle 3-4 weeks
- 10. (ii) Online Usability Testing
- 11. Copyright © 2014 Netizen Testing Sdn. Bhd. All rights reserved. All other trademarks, logos and copyrights are the property of their respective owners. 13 An Online Testing Cycle 1. Test Instruction 2. Testing with Users 3. Research & Analysis 6-7 days
- 12. Copyright © 2014 Netizen Testing Sdn. Bhd. All rights reserved. All other trademarks, logos and copyrights are the property of their respective owners. 14 Faster & Lower Cost & Natural Online Tester Matching Customers
- 13. Internet + Software You TT T T T Online Usability Testing Software TT T T
- 14. Example of Online Usability Testing
- 15. Copyright © 2014 Netizen Testing Sdn. Bhd. All rights reserved. All other trademarks, logos and copyrights are the property of their respective owners. 17 Converting All User Experience Into Useful Marketing Data
- 16. Copyright © 2014 Netizen Testing Sdn. Bhd. All rights reserved. All other trademarks, logos and copyrights are the property of their respective owners. 18 Education E-commerce Web Portal Entertainment Some Of The Companies That We Help To Do Online User Testing
- 17. Copyright © 2014 Netizen Testing Sdn. Bhd. All rights reserved. All other trademarks, logos and copyrights are the property of their respective owners. 19 Quality Assurance Evidence Based Understanding Users Empowerment Increase Loyalty Value of user testing
- 18. Difference Between Testing Methods? Quantitative Qualitative Google Analytics, Heat map, A/B Testing User Testing (UX Testing) Quantitative method tells you how many people come to the website, how many leave, how much time they stay on your website etc. Qualitative method tells you why people are leaving and the reasons why users behave in a particular way. Both Quantitative and Qualitative methods are complementary to each other. You will need both methods to have a better understanding of your user’s behavior.
- 19. Copyright © 2014 Netizen Testing Sdn. Bhd. All rights reserved. All other trademarks, logos and copyrights are the property of their respective owners. 21 Case Studies: User Testing Conducted Using Online Software
- 20. Copyright © 2014 Netizen Testing Sdn. Bhd. All rights reserved. All other trademarks, logos and copyrights are the property of their respective owners. 22 Case Study 1
- 21. Car Maker Websites Review 2013
- 23. 85 user testing sessions 1 month
- 24. Copyright © 2014 Netizen Testing Sdn. Bhd. All rights reserved. All other trademarks, logos and copyrights are the property of their respective owners. 26 Service Centre & Sales Outlet
- 25. Before After Using The Right Colours For Easy Reading
- 26. Before No Map for Sales & Service Outlets
- 27. No Map for Sales & Service Outlets After
- 28. Under The Sea Showroom
- 29. Copyright © 2014 Netizen Testing Sdn. Bhd. All rights reserved. All other trademarks, logos and copyrights are the property of their respective owners. 31 Case Study 2
- 30. Singapore National Day Rally 2013 Website
- 31. Copyright © 2014 Netizen Testing Sdn. Bhd. All rights reserved. All other trademarks, logos and copyrights are the property of their respective owners. 33 Which Design is the Best Based On User Testing?
- 32. The Winning Design 120% more engaging
- 33. Copyright © 2014 Netizen Testing Sdn. Bhd. All rights reserved. All other trademarks, logos and copyrights are the property of their respective owners. 35 Case Study 3
- 34. Copyright © 2014 Netizen Testing Sdn. Bhd. All rights reserved. All other trademarks, logos and copyrights are the property of their respective owners. 36
- 35. Mobile Apps Experience Testing The button design is not immediately obvious to the user as a ‘bookmark’ function.
- 36. Copyright © 2014 Netizen Testing Sdn. Bhd. All rights reserved. All other trademarks, logos and copyrights are the property of their respective owners. 38 Quality Assurance Evidence Based Understanding Users Empowerment Increase Loyalty Value of user testing
- 37. Copyright © 2014 Netizen Testing Sdn. Bhd. All rights reserved. All other trademarks, logos and copyrights are the property of their respective owners. 39 When to Test?
- 38. Copyright © 2014 Netizen Testing Sdn. Bhd. All rights reserved. All other trademarks, logos and copyrights are the property of their respective owners. 40 What Stages To Do User Research & Testing? 1. Research & Planning 2. Low-fi & High-fi Designs 3. Prototype 4. Development 5. Staging6. Pre Launch 7. Post Launch & Monitoring Continuous Improvement
- 39. Copyright © 2014 Netizen Testing Sdn. Bhd. All rights reserved. All other trademarks, logos and copyrights are the property of their respective owners. 41 Testing on Competitors User testing helps you benchmark your website and other competitor websites.
- 40. Copyright © 2014 Netizen Testing Sdn. Bhd. All rights reserved. All other trademarks, logos and copyrights are the property of their respective owners. 42 Prototype User Testing User testing helps you to learn about any critical issues with your user journey early on.
- 41. Copyright © 2014 Netizen Testing Sdn. Bhd. All rights reserved. All other trademarks, logos and copyrights are the property of their respective owners. 43 1. If you want a great product, you have got to test. 2. Testing is a repeating process. 3. Testing with 1 user is better than none. 4. Testing with 1 user is better than testing with 100 users near the end. 5. Testing insights will allow you to make informed decision. Facts to Remember
- 42. How to plan test instruction? 1. Task oriented
- 43. How to plan test instruction? 2. Non-leading questions Non-leading: Try to buy plane tickets for your family vacation. Leading: Press the red button and then click the 1st top left button with a airplane icon…
- 44. How Many Testers Do You Need? Source:media.nngroup.com/media/editor/alertbox/20000319-user-testing-diminshing-returns-curve.gif
- 45. Copyright © 2014 Netizen Testing Sdn. Bhd. All rights reserved. All other trademarks, logos and copyrights are the property of their respective owners. 47 Live Demo Any volunteer? It will be fun!
- 46. Being a Tester 1. Think Aloud 2. Say the Truth 3. It not testing your IQ 4. Give Suggestion 5. Say What You Like / Don’t Like
- 47. Moderator’s Role 1. Tour guide 2. Interrupt only when necessary 3. Don’t answer questions for tester 4. Ask questions starting with“What”or “How”if tester becomes quiet
- 48. Q&A
- 49. Winner of People’s Choice Award of Global Innovation through Science & Technology by the U.S. Department of State Media Coverage Online User Testing Software
- 50. Terima Kasih Email & LinkedIn: [email protected]