User Research and Usability Methods
workshop

Jon-Eric Steinbomer, Director of Research
Jessica Sears Steinbomer, Principal
!1
Our Agenda

!

9-10 Research Methods!
10-10:30 Recruiting Participants!
coffee <br>!
10:45-11:15 Study Plans & Moderator
Guides!
11:15-12:00 Moderate!!
12:00-1:00 Lunch & Presenting
Research
!2 | © 2013 Progress UX LLC
UX Research

!3 | © 2013 Progress UX LLC
!4 | © 2013 Progress UX LLC
UX Research

!

What people do!
!

How people use!
!

Small sample size - usually 8-12
people per study!
....but great depth

!5 | © 2013 Progress UX LLC
Key UX Research Principals



•
•
•
•

Test early - with prototypes whenever possible.!

•

Focus on behaviors

Evidence is more important than deliverables.!
Iterate on the design during the research phase.!
Collaboration with design & development.!
rather opinions.

“Individuals and interactions over
processes and tools” -Agile Manifesto
!6 | © 2013 Progress UX LLC
Methods

!7 | © 2013 Progress UX LLC
Structure Common! to All Methods
Study Planning!
Recruiting!
Study Sessions!
Analysis and Reporting!

!8 | © 2013 Progress UX LLC
Study Planning

•
•
•
•
•

!

What are the goals?!
What are the research questions?!
Who are the users?!
Which context is appropriate?!
Which research method is
appropriate?!

!9 | © 2013 Progress UX LLC
Study Plans Contain !

•
•
•
•
•
•

Research Goals!
Research Questions!
Participants!
Method!
Measures!
Specific Tasks and Questions!

!10 | © 2013 Progress UX LLC
Contexts

•
•
•

!

Usability Lab!
Remote !
On Location (ethnography)

!11 | © 2013 Progress UX LLC
Usability Lab
Behind the glass
Moderator communicates through microphone 

“voice of God”

!12 | © 2013 Progress UX LLC
Usability Lab Software

Morae ($1,995)

Silverback ($69.95)
!13 | © 2013 Progress UX LLC
Lab Best Practices

•
•
•
•

!

Participant Comfort!
Limit Distraction!
Just you and the participant!
Chat with observers/note-takers

!14 | © 2013 Progress UX LLC
Remote Research

Participant
Participant

Participant

Observers

Participant
Participant

Participant
Participant

Observers
Participant
Researchers

!15 | © 2013 Progress UX LLC

Participant
Ethnographic “bonus”
Participants are more comfortable as they speak

to us using their own OS, browser, resolution, etc.

!16 | © 2013 Progress UX LLC
Tools

!17 | © 2013 Progress UX LLC
Remote Case Study

!18 | © 2013 Progress UX LLC
Sweepstakes entry form

•

Too many abandons

!19 | © 2013 Progress UX LLC
18
Live Intercept

!20 | © 2013 Progress UX LLC
18
Recommendations sample

• Top-down design
• Validation before
human verify

• Better error
feedback

!21 | © 2013 Progress UX LLC
18
Remote UX Research Best Practices

•
•
•

Mind the time zones.!

•
•

Have a backup plan for the screen-share. !

One moderator per session.!
If time allows, start broad, then narrow down to your
subject (website, prototype, product).!
Test the screen share before the session.

!22 | © 2013 Progress UX LLC
18
Ethnography - Best Practices
!

•

Limit the number of
interviewers - 2 people if
possible!

•
•

Be nimble!

•

Note the environmental
factors!

•

Take lots of pictures and
video

Mind the background
noise!

!23 | © 2013 Progress UX LLC
18
Mobile Research

!24 | © 2013 Progress UX LLC
Mobile app/Hardware Research

!25 | © 2013 Progress UX LLC
18
Prototypes

!26 | © 2013 Progress UX LLC
Low-Fidelity Paper-based prototype

Full-Fidelity “clickable” prototype

Gesture prototype testing (Kinect)

Mid-fidelity Balsamiq prototype
!27 | © 2013 Progress UX LLC
Prototype Testing Best Practices

•
•
•
•

Flexibility when moderating is key!
Prototype should be easily modified!
Comfort with things breaking !
Make participant aware it’s a
prototype!

!28 | © 2013 Progress UX LLC
18
Moderating

!29 | © 2013 Progress UX LLC
Best Practices

•
•
•
•
•
•

Participant comfort!
It’s not about you (empathy)!
Place your participant as the expert!
Use their words!
Emphasize there is no right or wrong!
Don’t assume - ask!

!30 | © 2013 Progress UX LLC
18
Best Practices, cont.

•

Avoid asking leading questions or
“questioning with the target”!

•
•

Resist rescuing !

•

Introduce the goals and structure of
the session up-front

Let the participant lead as much as
possible!

!31 | © 2013 Progress UX LLC
18
Moderation Issues

•
•
•
•
•

Taking notes while moderating - takes practice!
Time management!
Talkers - interrupting gracefully!
Non-Talkers!
“Bad” Participants!
!

!32 | © 2013 Progress UX LLC
18
Recruiting Participants

!33 | © 2013 Progress UX LLC
Identify who you want to speak with
•
•
•
•

Personas
Marketing data
Call center data
Sales staff

!34 | © 2013 Progress UX LLC
Cast the net

Social media

Forums

Ethnio - Live Intercept
!35 | © 2013 Progress UX LLC
Recruiting - Ethnio Live Intercept

!36 | © 2013 Progress UX LLC
Collect the data

• Screening Survey

!37 | © 2013 Progress UX LLC
Scheduling

• Organization Tips

!38 | © 2013 Progress UX LLC
Make the Call

• Initial Contact
• Scheduling specifics
• Confirm
• Double Check

!39 | © 2013 Progress UX LLC
Bloopers and Out-takes

• No-shows- Oh No!
•

Recruit reserve participants

•

Make time in the schedule for reserves

• Mr. Wrong

!40 | © 2013 Progress UX LLC
Study Plans and Moderator Guides

!41 | © 2013 Progress UX LLC
Your turn!

!42 | © 2013 Progress UX LLC

More Related Content

PDF
Keeping your customers real
PDF
UX Designer's Toolkit - to design a better world
PDF
Measuring Visual Attentiveness: Eye Tracking on Wearable Devices
PPTX
Developing a Culture of UCD
PDF
Design Sprints Presentation at NoVA UX
PPTX
體驗劇場_1050308_W3_崑曲與使用者經驗_楊政達
PPTX
體驗劇場_1050524_W14_易用性測試_楊政達
PPTX
Usability Testing: Understanding End-Users through Observation
Keeping your customers real
UX Designer's Toolkit - to design a better world
Measuring Visual Attentiveness: Eye Tracking on Wearable Devices
Developing a Culture of UCD
Design Sprints Presentation at NoVA UX
體驗劇場_1050308_W3_崑曲與使用者經驗_楊政達
體驗劇場_1050524_W14_易用性測試_楊政達
Usability Testing: Understanding End-Users through Observation

Viewers also liked (6)

PDF
Endouble Ux design
PDF
From Participants to Pixels: Making the transition from UX Researcher to UX D...
PPTX
40 things you didn’t know about UX recruitment and were too afraid to ask
PDF
Agile14 - Anatomy Of A UX Framework
PDF
Stakeholder involvement in ux research
PDF
User experience doesn't happen on a screen: It happens in the mind.
Endouble Ux design
From Participants to Pixels: Making the transition from UX Researcher to UX D...
40 things you didn’t know about UX recruitment and were too afraid to ask
Agile14 - Anatomy Of A UX Framework
Stakeholder involvement in ux research
User experience doesn't happen on a screen: It happens in the mind.
Ad

Similar to Progress UX - Research Methods Workshop - 11/2013 (20)

PPT
Usability Testing Basics: Remote and In-Person Studies
PDF
Jan Moons at WUD16
PPTX
Users, Usability & User Experience - at PodCamp Cleveland 2011
PPTX
The "Rocket Science" of Corporate Usability Testing - Boris Rudnik (CyberArk)
PDF
Lean_UX--TC.220134502
PDF
4YFN 2016 Guerrilla UX
PPTX
Users are Losers! They’ll Like Whatever we Make! and Other Fallacies.
PDF
Lean User Research - UXPA 2013 Workshop
PDF
Guerrilla usability testing
PDF
When Qual Met UX
PDF
Rapid usability testing
PDF
Usability Testing Foundation
PDF
UX Research & PP projects @UXScotland 2014
PPTX
What we learned at EuroIA 2014
PPTX
Conducting User Research
PDF
Getting Started With User Research, Presented at Agile2010
PDF
ux flow and process
PDF
UsabilityMatters_Usability_Testing_Introduction_Workshop
PDF
User Testing: Adapt to Fit Your Needs
Usability Testing Basics: Remote and In-Person Studies
Jan Moons at WUD16
Users, Usability & User Experience - at PodCamp Cleveland 2011
The "Rocket Science" of Corporate Usability Testing - Boris Rudnik (CyberArk)
Lean_UX--TC.220134502
4YFN 2016 Guerrilla UX
Users are Losers! They’ll Like Whatever we Make! and Other Fallacies.
Lean User Research - UXPA 2013 Workshop
Guerrilla usability testing
When Qual Met UX
Rapid usability testing
Usability Testing Foundation
UX Research & PP projects @UXScotland 2014
What we learned at EuroIA 2014
Conducting User Research
Getting Started With User Research, Presented at Agile2010
ux flow and process
UsabilityMatters_Usability_Testing_Introduction_Workshop
User Testing: Adapt to Fit Your Needs
Ad

Recently uploaded (20)

PDF
xử lý ảnh thu nhận và xử lý trên FPGA ứng dụng
PPTX
WHY UPLOADING IS IMPORTANT TO DOWNLOAD SLIDES.pptx
PDF
APPLICATION OF MATRIX PROFILE TECHNIQUES TO DETECT INSIGHTFUL DISCORDS IN CLI...
PDF
This presentation is made for a design foundation class at Avantika Universit...
PPTX
F.Y.B.COM-A-ACC25359.pptx For a job or role? (e.g., Marketing Manager, Chief ...
PDF
Capture One Pro 16.6.5.17 for MacOS Crack Free Download New Version 2025
PDF
The Value of Professional Graphic Design
PPTX
Re-Fruit_Business_Plan_Presentation.pptx
PDF
Medical diagnostic centre case study Live
PDF
Jamil Islam, Diplpma in Electrical Engineer,CV.pdf
PDF
Designing Through Complexity - Four Perspectives.pdf
PPT
2 Development_Processes_and Organizations.ppt
PDF
Kindly check my updated curriculum Vitae
PPTX
Textile fibers are classified based on their origin, composition, and structu...
PPTX
Anjali synopsis seminar (15) (1) (1).pptx
PPTX
ACL English Introductionadsfsfadf 20200612.pptx
PDF
Engineering drawing lecture no 2 building blocks
PPT
Wheezing1.ppt powerpoint presentation for
PPTX
Respiration. Digestive & Excretory System.pptx
PPTX
UNITy8 human computer interac5ion-1.pptx
xử lý ảnh thu nhận và xử lý trên FPGA ứng dụng
WHY UPLOADING IS IMPORTANT TO DOWNLOAD SLIDES.pptx
APPLICATION OF MATRIX PROFILE TECHNIQUES TO DETECT INSIGHTFUL DISCORDS IN CLI...
This presentation is made for a design foundation class at Avantika Universit...
F.Y.B.COM-A-ACC25359.pptx For a job or role? (e.g., Marketing Manager, Chief ...
Capture One Pro 16.6.5.17 for MacOS Crack Free Download New Version 2025
The Value of Professional Graphic Design
Re-Fruit_Business_Plan_Presentation.pptx
Medical diagnostic centre case study Live
Jamil Islam, Diplpma in Electrical Engineer,CV.pdf
Designing Through Complexity - Four Perspectives.pdf
2 Development_Processes_and Organizations.ppt
Kindly check my updated curriculum Vitae
Textile fibers are classified based on their origin, composition, and structu...
Anjali synopsis seminar (15) (1) (1).pptx
ACL English Introductionadsfsfadf 20200612.pptx
Engineering drawing lecture no 2 building blocks
Wheezing1.ppt powerpoint presentation for
Respiration. Digestive & Excretory System.pptx
UNITy8 human computer interac5ion-1.pptx

Progress UX - Research Methods Workshop - 11/2013