User recruitment
What doesn't bring you joy
should be automated
Den Tserkovnyi
@dtserkovnyi
User recruitment: What doesn't bring you joy
 should be automated
Photo by Rob Janssen
I work at a product company called Studyportals.
We help students to find education abroad.
Most of us studied abroad
and it was amazing!
We want to share that feeling with everyone.
Our product
In simple words we have a website.
It’s visited by almost 3 million users a month.
We have 6 teams
and we design & build lots of stuff
• Monthly tactical research
• Feature based tests
• Strategic long-term
We test a lot
5
design sprints
in parallel
5×5=25 users
User recruitment: What doesn't bring you joy
 should be automated
Observers + no-shows
= loss of credibility
User recruitment: What doesn't bring you joy
 should be automated
BUT
Let’s start
from the beginning
So you built
an awesome prototype
…
But how are you going
to test it?
Usability test?
Great idea!
Who are you going to invite?
Friends?
Relatives?
Colleagues?
That guy?
User recruitment
Who likes to recruit users?
Please raise your hand
Wait…
• Professional testers
• Money
• Available users
• Middleman
let's imagine you don't have unlimited resources for user research...
Why not agency?
Lower overhead cost
& pay to the user
Students as users
Our users are students, should be easy to recruit?
Well, easier than medical doctors for sure, but…
We struggled with it as long as
I can remember
Referrals
GDPR
Campus visit!
User recruitment: What doesn't bring you joy
 should be automated
Warm
Summer day
True story
Great success!
32 students were recruited
in half a day
1
showed up
to the test
Remember I mentioned Summer?
Exams
How it worked
1. Get users
2. Send invites
3. Send reminders & hope for the best
4. Test
And test more
If there are no shows
A lot of effort for unpredictable
results
User recruitment: What doesn't bring you joy
 should be automated
Remote users?
No user background bias
Based on location
Easier to find
Closer to real environment
Hack day
Day for experiments and learning every two weeks.
When we are not busy fitting dinosaurs inside of the slide we do
projects that make our life easier or more delightful
User recruitment: What doesn't bring you joy
 should be automated
Automating parts of
user recruitment
Recruit
Screen
Schedule
Interview
At a glance
Recruit
Targeted ad
Email registered users
Previously recruited users
Screen
• Critical questions first (Save time for users)
• Consent form (Do not record personal data before consent)
• Personal details
• Contacts (phone number, Skype, email)
Phone number
decreased no shows
Better screening,
based on personas
Schedule
• Repeat technical requirements
• Repeat technical requirements
• Request confirmation via email
• Send reminders
User calls from
supermarket
Don’t blame the user
Blame your unclear instructions
Empathise!
We noticed that people who do not
confirm their participation often do
not show up, that makes user
researchers sad. And we need
them to be happy.
Interview
In-house
Mobile remote & in-house
Desktop remote moderated
Automate
Connect all services to Airtable
Record users and log sessions
Send reminders
Share with the team
Go wild!
User recruitment: What doesn't bring you joy
 should be automated
148 referrals
16 screener completions
3.32 EUR/conversion
10 students for the test
Numbers
Demo
From the user perspective
User recruitment: What doesn't bring you joy
 should be automated
User recruitment: What doesn't bring you joy
 should be automated
User recruitment: What doesn't bring you joy
 should be automated
User recruitment: What doesn't bring you joy
 should be automated
User recruitment: What doesn't bring you joy
 should be automated
User recruitment: What doesn't bring you joy
 should be automated
User recruitment: What doesn't bring you joy
 should be automated
What else?
Recruit more than you need
No-shows are expensive (pay more than participants’ hourly rate)
Experiment with research methods
Don’t forget about behavioral data
https://xkcd.com/1205/
How are you doing it?
Discussion
Ask me anything
@dtserkovnyi

More Related Content

PPTX
Moderated user testing: do's and don'ts
PPTX
Intro to Design w/ Pivotal Labs
PPT
WP Meetup PDX Slides on Site Strategy
PPTX
Practical customer development
PDF
DrupalCon Austin: UX Bootcamp workshop
PPTX
How Yammer Stayed Lean Post-Acquisition: Customer Development as Survival Str...
PPTX
Practicing Customer Development (for Lean Startup Circle Copenhagen)
PPT
Better design
Moderated user testing: do's and don'ts
Intro to Design w/ Pivotal Labs
WP Meetup PDX Slides on Site Strategy
Practical customer development
DrupalCon Austin: UX Bootcamp workshop
How Yammer Stayed Lean Post-Acquisition: Customer Development as Survival Str...
Practicing Customer Development (for Lean Startup Circle Copenhagen)
Better design

What's hot (20)

PDF
Rethinking UX Research - Design4Drupal 2014 keynote presentation
DOCX
Task 2 22
PPTX
Usability & Usability Testing
PPTX
User Research is About Surprise
PDF
Peep Laja - Strategy - Conversion Hotel 2015
PDF
05. preparing for an interview in user experience
PDF
[Elite Camp 2016] Peep Laja - Fresh Out Of the Oven
 
PDF
Design Sprints
PPT
KISSinsights Customer Development Tactics
PPTX
How to Build a Great Team
PDF
Running a Freelance WordPress Business
PDF
[Elite Camp 2016] Craig Sullivan - Elite Camp Summary Session
 
PPT
Usability for Tough Times
PPT
Usability Studies for Public Libraries
PDF
IXDA Chicago May 2015 : Recruiting Palace Gate Jennifer Hegener
PDF
Start Building Professional Network
PDF
IXDA Chicago May 2015 : Recruiting Wunderland Judi Wunderlich
PDF
ConCon Manchester: user journeys for services
PPT
Session 1051: Improve Your Website With Usability Testing
PPT
The interviewme-app
Rethinking UX Research - Design4Drupal 2014 keynote presentation
Task 2 22
Usability & Usability Testing
User Research is About Surprise
Peep Laja - Strategy - Conversion Hotel 2015
05. preparing for an interview in user experience
[Elite Camp 2016] Peep Laja - Fresh Out Of the Oven
 
Design Sprints
KISSinsights Customer Development Tactics
How to Build a Great Team
Running a Freelance WordPress Business
[Elite Camp 2016] Craig Sullivan - Elite Camp Summary Session
 
Usability for Tough Times
Usability Studies for Public Libraries
IXDA Chicago May 2015 : Recruiting Palace Gate Jennifer Hegener
Start Building Professional Network
IXDA Chicago May 2015 : Recruiting Wunderland Judi Wunderlich
ConCon Manchester: user journeys for services
Session 1051: Improve Your Website With Usability Testing
The interviewme-app
Ad

Similar to User recruitment: What doesn't bring you joy
 should be automated (20)

PPTX
Best Practices on Recruiting Participants for Remote User Testing
PDF
Understanding The Value Of User Research, Usability Testing, and Information ...
PPTX
Zombie Usability
PPTX
Blind Dates - Or the right choice of Test Users.
PPTX
Usability Testing Basics: What's it All About? at Web SIG Cleveland
PPTX
Onrec Talk V9
PDF
How to Run 100 User Tests in Two Days
PPTX
The Usability of Usability
DOCX
Usability engineeringHow to conduct User testing Week 4.docx
PDF
Produkt Tank Amsterdam PULSE UX
PDF
Product Tank Amsterdam Pulse UX Presentation
PPTX
Job Search - Jayakumar Krishnamurthy - Case-study-slide-deck.pptx
PPTX
Usability Testing for People w/ Disabilities
PPTX
Blind Dates - Or the right choice of Test U sers
PDF
User Experience Design Fundamentals - Part 2: Talking with Users
PDF
Usability Testing and QA 12 11-15
PDF
Automated tests workshop
PDF
Creating Maintainable Automated Acceptance Tests
PDF
TAPOST Conference 2016 Riga // Better Products Faster: Let's bring the user i...
PDF
UCD & Usability testing at the St. Augustine Campus
Best Practices on Recruiting Participants for Remote User Testing
Understanding The Value Of User Research, Usability Testing, and Information ...
Zombie Usability
Blind Dates - Or the right choice of Test Users.
Usability Testing Basics: What's it All About? at Web SIG Cleveland
Onrec Talk V9
How to Run 100 User Tests in Two Days
The Usability of Usability
Usability engineeringHow to conduct User testing Week 4.docx
Produkt Tank Amsterdam PULSE UX
Product Tank Amsterdam Pulse UX Presentation
Job Search - Jayakumar Krishnamurthy - Case-study-slide-deck.pptx
Usability Testing for People w/ Disabilities
Blind Dates - Or the right choice of Test U sers
User Experience Design Fundamentals - Part 2: Talking with Users
Usability Testing and QA 12 11-15
Automated tests workshop
Creating Maintainable Automated Acceptance Tests
TAPOST Conference 2016 Riga // Better Products Faster: Let's bring the user i...
UCD & Usability testing at the St. Augustine Campus
Ad

Recently uploaded (20)

PDF
commercial kitchen design for owners of restaurants and hospitality
PPTX
Tempo_UIUX_Case_Study Tempo_UIUX_Case_Study
DOCX
allianz arena munich case study of long span structure
PDF
Medical diagnostic centre case study Live
PDF
APPLICATION OF MATRIX PROFILE TECHNIQUES TO DETECT INSIGHTFUL DISCORDS IN CLI...
PDF
Capture One Pro 16.6.5.17 for MacOS Crack Free Download New Version 2025
PPTX
carcinogenic agevcccvvvvhhgxdsxcgjnts.pptx
PPTX
Succession Planning Project Proposal PowerPoint Presentation
PPTX
Chapter7 design and Implementation.pptx
PDF
xử lý ảnh thu nhận và xử lý trên FPGA ứng dụng
PDF
SEMINAR 21st classroom SCE by school science
PPTX
LESSON-3-Introduction-to-Office-Suite.pptx
PPTX
G4Q2W1 PPT SCIENCE (MATATAG) @Sir Ims.pptx
PPTX
CVS MODULE 2.pptxjjjjjjjjjjjjkkkkjjiiiiii
PDF
commercial kitchen design for owners of restaurants and hospitality
PDF
Interior_Design_and_Interior_Architectur.pdf
PPTX
Respiration. Digestive & Excretory System.pptx
PPTX
Wrought Iron Crafts of Dindori -FINAL30112021.pptx
PDF
B440713.pdf American Journal of Multidisciplinary Research and Review
PDF
C462831.pdf American Journal of Multidisciplinary Research and Review
commercial kitchen design for owners of restaurants and hospitality
Tempo_UIUX_Case_Study Tempo_UIUX_Case_Study
allianz arena munich case study of long span structure
Medical diagnostic centre case study Live
APPLICATION OF MATRIX PROFILE TECHNIQUES TO DETECT INSIGHTFUL DISCORDS IN CLI...
Capture One Pro 16.6.5.17 for MacOS Crack Free Download New Version 2025
carcinogenic agevcccvvvvhhgxdsxcgjnts.pptx
Succession Planning Project Proposal PowerPoint Presentation
Chapter7 design and Implementation.pptx
xử lý ảnh thu nhận và xử lý trên FPGA ứng dụng
SEMINAR 21st classroom SCE by school science
LESSON-3-Introduction-to-Office-Suite.pptx
G4Q2W1 PPT SCIENCE (MATATAG) @Sir Ims.pptx
CVS MODULE 2.pptxjjjjjjjjjjjjkkkkjjiiiiii
commercial kitchen design for owners of restaurants and hospitality
Interior_Design_and_Interior_Architectur.pdf
Respiration. Digestive & Excretory System.pptx
Wrought Iron Crafts of Dindori -FINAL30112021.pptx
B440713.pdf American Journal of Multidisciplinary Research and Review
C462831.pdf American Journal of Multidisciplinary Research and Review

User recruitment: What doesn't bring you joy
 should be automated

Editor's Notes

  • #2: My goal is to make you think creatively about the manual tasks you are performing. If you challenge your behaviour and automate your workflow I will be very happy.
  • #3: My name is Den, and barely anyone can pronounce my surname. Born in Ukraine, moved to the Netherlands 7 years ago. I had a pleasure to work in a dynamic environments with a great teams as UX researcher, UX designer, Scrum Master, Product Owner. Last 3.5 years I’m leading UX design team at SP.
  • #6: Website tests (mobile, desktop)
  • #13: Observers & no-shows. Losing credibility
  • #15: And do some visualisation
  • #21: No, we don’t…
  • #22: Is there problem to solve?
  • #31: Could be even more, but we didn’t want to bother people indoors too much, because most of them were busy.
  • #43: Problem / solution
  • #47: Ask phone number
  • #49: + Personas
  • #53: Please respond to this email to confirm your participation.
  • #55: $8 Calendly 20 Zapier
  • #67: NN hourly rate of the user is not important. No-shows are more expensive