Keeping your customers real
Jon-Eric Steinbomer, Director of Research
Lean Startup Circle - 2013
| © Progress UX LLC2
| © Progress UX LLC
UX Research is not Market Research
3
User Experience
Research
•What people do
•How people use
•Smaller sample sizes
Market
Research
•What people say
•What people will buy
•Larger sample sizes
| © Progress UX LLC4
About Progress
Austin, Texas
Home Office and Usability Lab
Bellevue, Washington
Satellite Office
| © Progress UX LLC
Core UX Research Methods
5
Usability Testing
Remote and Lab-Based
Prototype Testing
App (mobile) Research
Eye Tracking
Natural Interface (NUI)
Research
Expert Review
Out of Box Testing
User Research
Card Sorting
Tree Testing
Personas
Surveys
Contextual Interview/On-
Site Visits
Diary Studies
Listening Lab
Personas
6
The over-achiever The follower The Idealist
© Nick Agin
| © Progress UX LLC
What are Personas?
7
“Personas are not real people. They
represent real people throughout
the design process. They are
hypothetical archetypes of actual
users.”
Alan Cooper
| © Progress UX LLC
Why Personas?
8
• The “average” user does not exist.
• We are not our users.
• Build consensus.
• Foster empathy.
• Support ideation.
• Research study recruiting.
| © Progress UX LLC
Endless flavors!
9
| © Progress UX LLC
Characteristics of Ineffective Personas
10
• Contain too much “fluff”
information.
• Are based on dubious or
unknown sources.
• Aspirational - who you wish
your customers were.
• Static.
• Are not used.
| © Progress UX LLC
Characteristics of effective personas
11
• Are based on direct user
research.
• Convey only relevant
information, i.e. - what
people want, what they are,
what they do - their story!
• Are iteratively refined and
validated.
• Are often referenced in
discussions and ideation.
“Roger”“Early Adopter”
| © Progress UX LLC
Final thoughts on personas
12
“Personas are not real
people. They represent
real people throughout
the design process. They
are hypothetical
archetypes of actual users.
Although they are
imaginary, they are
defined with significant
rigor and precision.”
Alan Cooper
Remote UX Research
13
| © Progress UX LLC
Remote UX Research - Expanded Reach
14
Researchers
Participant
Observers
Participant
Participant
Participant
Participant
Participant
Participant
Participant
Participant
Observers
| © Progress UX LLC
Remote benefit - ethnography
Participants are more comfortable as they speak
to us using their own OS, browser, resolution, etc.
15
| © Progress UX LLC
Remote UX Research & Real-time Interaction
16
| © Progress UX LLC
Remote UX Research Best Practices
• Mind the time zones.
• One moderator per session.
• If time allows, start broad, then narrow down to
your subject (website, prototype, product).
• Have a backup plan for the screen-share.
17
Mobile/Hardware Research
Back to the lab!
18
| © Progress UX LLC
In-Person and On-Device
19
| © Progress UX LLC
Mobile app/Hardware Research
20
http://www.mrtappy.com/
| © Progress UX LLC
Out of Box Testing (OOBE)
21
Card Sorting
22
| © Progress UX LLC
Card Sorting
Helps us understand:
• user-derived labels (what do people call things)
• which items belong in existing categories (what goes where)
23
| © Progress UX LLC
Card Sorting with OptimalSort
24
| © Progress UX LLC
Card Sort Results
25
Dendrogram visualization
| © Progress UX LLC
Tree Validation
Helps us understand how
well a given navigation
structure works
26
Diary Studies
27
| © Progress UX LLC
Diary Studies - Longitudinal UX
Helps us gain:
• Iterative feedback collected over time and use.
• Take us beyond initial discovery.
28
research.microsoft.com
Recruiting Participants
29
| © Progress UX LLC
Identify who you want to speak with
30
• Personas
• Marketing data
• Call center data
• Sales staff
| © Progress UX LLC
Cast the net
31
Forums
Social media
Ethnio - Live Intercept
| © Progress UX LLC
Screen each candidate
32
| © Progress UX LLC
Compensation
33
A few best practices
34
| © Progress UX LLC35
“everything we perceive is filtered and
biased by our version of things.”
“...understand one’s behavior free
from the tyranny of one’s own
expectations and biases.”
| © Progress UX LLC
UX Research best practices
36
• Keep your ego in check.
• “Users” don’t exist, they are (we are) real people with
complex and sometimes messy lives. Dig in to find people’s
story.
• Conduct regular product research with real people. Weekly
or bi-monthly if possible. Get it on the calendar.
Thank You!
@ProgressUX
je@experienceprogress.com
Jon-Eric Steinbomer
www.experienceprogress.com

More Related Content

PPTX
What is User Experience?
PDF
Progress UX - Research Methods Workshop - 11/2013
PDF
Why User Experience Matters
PDF
Tool time: Remote Unmoderated Usability Testing Tools
PDF
Value and Politics of Usability
PDF
Introduction to UX Research
PDF
Everything You Always Wanted to Know About Bad UX Research But Were Afraid to...
PDF
The perfect ux designer toolkit
What is User Experience?
Progress UX - Research Methods Workshop - 11/2013
Why User Experience Matters
Tool time: Remote Unmoderated Usability Testing Tools
Value and Politics of Usability
Introduction to UX Research
Everything You Always Wanted to Know About Bad UX Research But Were Afraid to...
The perfect ux designer toolkit

What's hot (20)

PDF
Leveraging Persuasive Architecture
PDF
User Experience: An Industry (Always) in Transition
PDF
Embedded UX Research by Stijn Nieuwendijk @ UX Istanbul 2016
PPTX
Introduction to User Experience Design 06/22/19
PDF
MCN 2014 - The truly responsive web - Cristiano Bianchi - Keepthinking
PDF
Business Social Media - Central CT SIM Meeting
PPTX
Introduction to User Experience Design 2/16/19
PPTX
Introduction to User Experience Design 06/22/18
PPTX
Introduction to User Experience Design 12/08/18
PPTX
Introduction to User Experience Design 10/05/19
PPTX
Basics of Interaction Design and Strategy
PDF
Usability Testing: Backbone of UX Research - DevUp2018
PPTX
Introduction to User Experience Design 12/07/19
PPTX
A brief overview of the history and practice of user experience by Ian Westbrook
PDF
UX Designer's Toolkit - to design a better world
PDF
Putting Users in UX: Research Methods for Design
PPTX
UX books
PPTX
Introduction to User Experience Design 04/27/19
PPTX
UX day launchpad july 2017
PDF
UXify Eindhoven: Best practices on the Web
Leveraging Persuasive Architecture
User Experience: An Industry (Always) in Transition
Embedded UX Research by Stijn Nieuwendijk @ UX Istanbul 2016
Introduction to User Experience Design 06/22/19
MCN 2014 - The truly responsive web - Cristiano Bianchi - Keepthinking
Business Social Media - Central CT SIM Meeting
Introduction to User Experience Design 2/16/19
Introduction to User Experience Design 06/22/18
Introduction to User Experience Design 12/08/18
Introduction to User Experience Design 10/05/19
Basics of Interaction Design and Strategy
Usability Testing: Backbone of UX Research - DevUp2018
Introduction to User Experience Design 12/07/19
A brief overview of the history and practice of user experience by Ian Westbrook
UX Designer's Toolkit - to design a better world
Putting Users in UX: Research Methods for Design
UX books
Introduction to User Experience Design 04/27/19
UX day launchpad july 2017
UXify Eindhoven: Best practices on the Web
Ad

Viewers also liked (6)

PDF
Designing our future overlords or: How I Learned to Stop Worrying and Love Ro...
PPTX
Robots & Robotics
PPT
BASICS and INTRODUCTION of ROBOTICS
PDF
Introduction to Mobile Robotics
PPTX
Humanoid robots
PDF
Study: The Future of VR, AR and Self-Driving Cars
Designing our future overlords or: How I Learned to Stop Worrying and Love Ro...
Robots & Robotics
BASICS and INTRODUCTION of ROBOTICS
Introduction to Mobile Robotics
Humanoid robots
Study: The Future of VR, AR and Self-Driving Cars
Ad

Similar to Keeping your customers real (20)

PPTX
Fundamentals and practices of UX research
PPTX
User Experience Basics
PDF
Webinar on UX ToolBox for Product Managers : UX-PM
PPTX
UXD - A quick overview on what you need to work with your UX team
PDF
BTK Designing for the web 2016 - UX
PDF
UX Bootcamp Fall 2015 General Assembly
PDF
Scaling empathy with personas
PDF
Brand ux (4)
PDF
Jan Moons at WUD16
PDF
UXPA Unconference presentation : Is it time to kill personas?
PPTX
User Research Portfolio3
PPTX
Conducting User Research
PDF
Intro to UX UI Presentation at StartCo - May 24, 2017
PDF
UX (User Experience) Process, May 2017
PPTX
User Experience & Extreme Programming: An Experience Report
PPTX
What we learned at EuroIA 2014
PDF
UX is for Losers
PPTX
Putting Personas to Work at UX Pittsburgh
PPTX
Putting Personas to Work at IIBA Cleveland
PPTX
Putting Personas to Work: Getting personas adopted throughout your organization
Fundamentals and practices of UX research
User Experience Basics
Webinar on UX ToolBox for Product Managers : UX-PM
UXD - A quick overview on what you need to work with your UX team
BTK Designing for the web 2016 - UX
UX Bootcamp Fall 2015 General Assembly
Scaling empathy with personas
Brand ux (4)
Jan Moons at WUD16
UXPA Unconference presentation : Is it time to kill personas?
User Research Portfolio3
Conducting User Research
Intro to UX UI Presentation at StartCo - May 24, 2017
UX (User Experience) Process, May 2017
User Experience & Extreme Programming: An Experience Report
What we learned at EuroIA 2014
UX is for Losers
Putting Personas to Work at UX Pittsburgh
Putting Personas to Work at IIBA Cleveland
Putting Personas to Work: Getting personas adopted throughout your organization

Recently uploaded (20)

PDF
4 layer Arch & Reference Arch of IoT.pdf
PDF
Data Virtualization in Action: Scaling APIs and Apps with FME
PDF
CXOs-Are-you-still-doing-manual-DevOps-in-the-age-of-AI.pdf
PDF
Produktkatalog für HOBO Datenlogger, Wetterstationen, Sensoren, Software und ...
PDF
Improvisation in detection of pomegranate leaf disease using transfer learni...
PPTX
Custom Battery Pack Design Considerations for Performance and Safety
PDF
INTERSPEECH 2025 「Recent Advances and Future Directions in Voice Conversion」
PPTX
Training Program for knowledge in solar cell and solar industry
PDF
Early detection and classification of bone marrow changes in lumbar vertebrae...
PDF
Enhancing plagiarism detection using data pre-processing and machine learning...
PDF
NewMind AI Weekly Chronicles – August ’25 Week IV
PDF
Advancing precision in air quality forecasting through machine learning integ...
PDF
5-Ways-AI-is-Revolutionizing-Telecom-Quality-Engineering.pdf
PDF
The influence of sentiment analysis in enhancing early warning system model f...
PDF
Statistics on Ai - sourced from AIPRM.pdf
PDF
Transform-Your-Factory-with-AI-Driven-Quality-Engineering.pdf
PPTX
Build Your First AI Agent with UiPath.pptx
PPTX
Configure Apache Mutual Authentication
PDF
Consumable AI The What, Why & How for Small Teams.pdf
PDF
Convolutional neural network based encoder-decoder for efficient real-time ob...
4 layer Arch & Reference Arch of IoT.pdf
Data Virtualization in Action: Scaling APIs and Apps with FME
CXOs-Are-you-still-doing-manual-DevOps-in-the-age-of-AI.pdf
Produktkatalog für HOBO Datenlogger, Wetterstationen, Sensoren, Software und ...
Improvisation in detection of pomegranate leaf disease using transfer learni...
Custom Battery Pack Design Considerations for Performance and Safety
INTERSPEECH 2025 「Recent Advances and Future Directions in Voice Conversion」
Training Program for knowledge in solar cell and solar industry
Early detection and classification of bone marrow changes in lumbar vertebrae...
Enhancing plagiarism detection using data pre-processing and machine learning...
NewMind AI Weekly Chronicles – August ’25 Week IV
Advancing precision in air quality forecasting through machine learning integ...
5-Ways-AI-is-Revolutionizing-Telecom-Quality-Engineering.pdf
The influence of sentiment analysis in enhancing early warning system model f...
Statistics on Ai - sourced from AIPRM.pdf
Transform-Your-Factory-with-AI-Driven-Quality-Engineering.pdf
Build Your First AI Agent with UiPath.pptx
Configure Apache Mutual Authentication
Consumable AI The What, Why & How for Small Teams.pdf
Convolutional neural network based encoder-decoder for efficient real-time ob...

Keeping your customers real

  • 1. Keeping your customers real Jon-Eric Steinbomer, Director of Research Lean Startup Circle - 2013
  • 2. | © Progress UX LLC2
  • 3. | © Progress UX LLC UX Research is not Market Research 3 User Experience Research •What people do •How people use •Smaller sample sizes Market Research •What people say •What people will buy •Larger sample sizes
  • 4. | © Progress UX LLC4 About Progress Austin, Texas Home Office and Usability Lab Bellevue, Washington Satellite Office
  • 5. | © Progress UX LLC Core UX Research Methods 5 Usability Testing Remote and Lab-Based Prototype Testing App (mobile) Research Eye Tracking Natural Interface (NUI) Research Expert Review Out of Box Testing User Research Card Sorting Tree Testing Personas Surveys Contextual Interview/On- Site Visits Diary Studies Listening Lab
  • 6. Personas 6 The over-achiever The follower The Idealist © Nick Agin
  • 7. | © Progress UX LLC What are Personas? 7 “Personas are not real people. They represent real people throughout the design process. They are hypothetical archetypes of actual users.” Alan Cooper
  • 8. | © Progress UX LLC Why Personas? 8 • The “average” user does not exist. • We are not our users. • Build consensus. • Foster empathy. • Support ideation. • Research study recruiting.
  • 9. | © Progress UX LLC Endless flavors! 9
  • 10. | © Progress UX LLC Characteristics of Ineffective Personas 10 • Contain too much “fluff” information. • Are based on dubious or unknown sources. • Aspirational - who you wish your customers were. • Static. • Are not used.
  • 11. | © Progress UX LLC Characteristics of effective personas 11 • Are based on direct user research. • Convey only relevant information, i.e. - what people want, what they are, what they do - their story! • Are iteratively refined and validated. • Are often referenced in discussions and ideation. “Roger”“Early Adopter”
  • 12. | © Progress UX LLC Final thoughts on personas 12 “Personas are not real people. They represent real people throughout the design process. They are hypothetical archetypes of actual users. Although they are imaginary, they are defined with significant rigor and precision.” Alan Cooper
  • 14. | © Progress UX LLC Remote UX Research - Expanded Reach 14 Researchers Participant Observers Participant Participant Participant Participant Participant Participant Participant Participant Observers
  • 15. | © Progress UX LLC Remote benefit - ethnography Participants are more comfortable as they speak to us using their own OS, browser, resolution, etc. 15
  • 16. | © Progress UX LLC Remote UX Research & Real-time Interaction 16
  • 17. | © Progress UX LLC Remote UX Research Best Practices • Mind the time zones. • One moderator per session. • If time allows, start broad, then narrow down to your subject (website, prototype, product). • Have a backup plan for the screen-share. 17
  • 19. | © Progress UX LLC In-Person and On-Device 19
  • 20. | © Progress UX LLC Mobile app/Hardware Research 20 http://www.mrtappy.com/
  • 21. | © Progress UX LLC Out of Box Testing (OOBE) 21
  • 23. | © Progress UX LLC Card Sorting Helps us understand: • user-derived labels (what do people call things) • which items belong in existing categories (what goes where) 23
  • 24. | © Progress UX LLC Card Sorting with OptimalSort 24
  • 25. | © Progress UX LLC Card Sort Results 25 Dendrogram visualization
  • 26. | © Progress UX LLC Tree Validation Helps us understand how well a given navigation structure works 26
  • 28. | © Progress UX LLC Diary Studies - Longitudinal UX Helps us gain: • Iterative feedback collected over time and use. • Take us beyond initial discovery. 28 research.microsoft.com
  • 30. | © Progress UX LLC Identify who you want to speak with 30 • Personas • Marketing data • Call center data • Sales staff
  • 31. | © Progress UX LLC Cast the net 31 Forums Social media Ethnio - Live Intercept
  • 32. | © Progress UX LLC Screen each candidate 32
  • 33. | © Progress UX LLC Compensation 33
  • 34. A few best practices 34
  • 35. | © Progress UX LLC35 “everything we perceive is filtered and biased by our version of things.” “...understand one’s behavior free from the tyranny of one’s own expectations and biases.”
  • 36. | © Progress UX LLC UX Research best practices 36 • Keep your ego in check. • “Users” don’t exist, they are (we are) real people with complex and sometimes messy lives. Dig in to find people’s story. • Conduct regular product research with real people. Weekly or bi-monthly if possible. Get it on the calendar.