Evaluating the User Experience
Sónia Sousa & Mati Mõttus
Workshop 1
6 Thinking Hats
6 Thinking Hats
Edward De Bono’s Team
Discussion Method
ixdworks.com
ixdworks.com
From: hungergames4b3.wordpress.com
ixdworks.com
From: http://amyrozelmartin.com/2012/11/6-thinking-hats-by-edward-de-bono/
For example...
...we have an idea to run a restaurant
White Hat:
“What do we know about this area?
What is situation on the market?
What are the statistics that we are aware about?
What is the information that is currently lacking and we
need to do a research for?”
Yellow Hat:
“There is a free spot on the market for vegan cuisine!
City council has launched a program of supporting new
healthy-dining spots!
We have a great team and we can make it work!”
Green Hat:
“We can add a hotel to the restaurant to get additional
profit.
We can buy an old building and re-construct it ourselves
to save some money.
We can cooperate with local farmers and get fresh fruits
and vegetables”
Black Hat:
“There is already a lot of restaurants in the city.
Because of cold climate restaurant will be very
dependant on imported fruits and vegetables.
Adding hotel will demand hiring more people = spend
more.
People of older age do not use social media, so only
teenagers will know about us”
Red Hat:
“People love eating out because it saves time.
People also love healthy food because it helps them to
stay fit.
People avoid vegan places because they have bad
reputation.
I have a feeling that we are going to succeed!”
Blue Hat:
“How would we present ourselves on the market?
What is our target audience?
Better option to run a property — rent it or buy it?
Who will be recruiting staff members? What is the
criteria?
What is our agenda and end goal?
How much time do we have for everything?”
To do:
● Pick at least one hat
● During the session you can change hats, but 2 is a
max.
● Try to avoid Black hat
● Make sure someone from your team wears Blue hat
ixdworks.com
ixdworks.com
From: biggerplate.com
Workshop 1
Comparative evaluation
Comparative evaluation
• Evaluation of concepts:
– Iterative product benchmarking
• lab studies, before usage, UX experts
• Aims of benchmarking
– Mature own idea
• Assess the competition
• Seek inspiration
• When to stop
– When the resulting table is saturated (when adding
new products does not bring added value)
@ Sónia Sousa
features Service 1 service 2 service 3 service 4
feature 1 x x x x
feature 2 x
feature 3 x x x
feature 4 x x x x
feature 5 x x x
feature 6 x
feature 7 x x
feature 8 x
feature 9 x
feature 10 x
feature 11
feature 12
feature 13
feature 14
The result
@ Sónia Sousa
Extra
features
Usability Study Scenario X
type of usability metrics Task Success Task Time Errors Efficiency Learnability
Issues base
metrics
Self-reported
metrics
Behavioral
and
physiological
metrics
Combined
and
comparative
metrics
Live Website
metrics
Card-sorting
data
Completing a transaction X X X X X
Comparing products X X X X
Evaluating frequent use of
the same product
X X X X X
Evaluating navigation and
information architecture
X X X X
Increasing awareness X X X
Problem discovery X X
Maximizing usability for a
critical product
X X X X
Creating an overall
positive user experience
X
Evaluating the impact of
subtle changes
X
Comparing alternative
designs
X X X X
@ Sónia Sousa
individual assignment 1
@ Sónia Sousa
• Write a 1000 characters blog post about the
three articles on Google Drive
– The aim is for you…
• To compare the different approaches; and
• To elaborate on which one you would personally select
and use to evaluate the early concepts of your ongoing
project.
– Please see the course blog for more information.
– The deadline is 28th of February.
@ Sónia Sousa
First reading assignment
• Please see the course blog for more
information
– Remember this is a independent work
assignment.
– The deadline is 28th of February.
@ Sónia Sousa

More Related Content

PPTX
MG673 - Session 1
PDF
Contextual Inquiry and Personas in Interaction Design
PPTX
An Introduction to the World of User Research
PDF
Contextual Inquiry
PPTX
User Experience (UX) Research in Healthcare
PDF
Content strategy - How to get it, how to test
PPTX
Usability testing through the decades
PDF
User Testing and Research
MG673 - Session 1
Contextual Inquiry and Personas in Interaction Design
An Introduction to the World of User Research
Contextual Inquiry
User Experience (UX) Research in Healthcare
Content strategy - How to get it, how to test
Usability testing through the decades
User Testing and Research

What's hot (20)

PPTX
Strategies for writing customer focused web content
PDF
How to Conduct Usability Studies: A Librarian Primer
PDF
How to build user experience into courses
PPTX
Introduction to UX Research: Fundamentals of Contextual Inquiry
PPTX
Experience Research Best Practices
PDF
Contextual Inquiry in Interaction Design
PPTX
Writing surveysthatwork
PDF
Research Strategy? Try Black Magic
PDF
Not Losing Sight of the Essential: Enjoying your Career in Research
PDF
Why and How to Get a PhD? (In software engineering)
PDF
The State of Software Engineering Research
PDF
Why and How to get a PhD (in Software Engineering)
PDF
Contextual inquiry
PDF
Kicking Ass with your Research
PDF
Purposeful UX Research given the Constraints from a Pandemic
PDF
Contextual inquiry case
PDF
Context Chat - why, what & how
PDF
TAPOST Conference 2016 Riga // Better Products Faster: Let's bring the user i...
PPTX
10 tips for a better UX survey
PDF
UsabilityMatters_Usability_Testing_Introduction_Workshop
Strategies for writing customer focused web content
How to Conduct Usability Studies: A Librarian Primer
How to build user experience into courses
Introduction to UX Research: Fundamentals of Contextual Inquiry
Experience Research Best Practices
Contextual Inquiry in Interaction Design
Writing surveysthatwork
Research Strategy? Try Black Magic
Not Losing Sight of the Essential: Enjoying your Career in Research
Why and How to Get a PhD? (In software engineering)
The State of Software Engineering Research
Why and How to get a PhD (in Software Engineering)
Contextual inquiry
Kicking Ass with your Research
Purposeful UX Research given the Constraints from a Pandemic
Contextual inquiry case
Context Chat - why, what & how
TAPOST Conference 2016 Riga // Better Products Faster: Let's bring the user i...
10 tips for a better UX survey
UsabilityMatters_Usability_Testing_Introduction_Workshop
Ad

Viewers also liked (20)

PPTX
Ifi7155.DT-Lesson1
PPTX
Ifi7155 Contextualization
PPTX
AXE Anticipated eXperience Evaluation - Early feedback on your concept and de...
PDF
Anticipated experiences: Early product concept evaluation - Lutz Gegner at HC...
PPTX
Ifi7174 lesson4
PDF
Lesson 17
PPTX
A key contribution for leveraging trustful interactions
PPTX
Ifi7184 lesson5
PPTX
Literature, Law and Learning: Excursions from Computer Science
PPTX
Ifi7174 lesson3
PPTX
Ifi7184 lesson4
PDF
My ph.d Defence
PPTX
Trust workshop
PPTX
Ifi7174 lesson2
PDF
Nettets genkomst?
PDF
Helping users in assessing the trustworthiness of user-generated reviews
PDF
Technology, Trust, & Transparency
PPTX
Trust from a Human Computer Interaction perspective
PPTX
Ifi7184 lesson3
PPTX
Ifi7184 lesson7
Ifi7155.DT-Lesson1
Ifi7155 Contextualization
AXE Anticipated eXperience Evaluation - Early feedback on your concept and de...
Anticipated experiences: Early product concept evaluation - Lutz Gegner at HC...
Ifi7174 lesson4
Lesson 17
A key contribution for leveraging trustful interactions
Ifi7184 lesson5
Literature, Law and Learning: Excursions from Computer Science
Ifi7174 lesson3
Ifi7184 lesson4
My ph.d Defence
Trust workshop
Ifi7174 lesson2
Nettets genkomst?
Helping users in assessing the trustworthiness of user-generated reviews
Technology, Trust, & Transparency
Trust from a Human Computer Interaction perspective
Ifi7184 lesson3
Ifi7184 lesson7
Ad

Similar to Workshop 1 (20)

PDF
Peter Shanley, Principal & Evangelist at Neo
PPT
Barbara cruz see4334 2017
PPTX
Polychrome Testing: Ideas & Practices to Improve Software Testing | QASymphon...
PPTX
Intellectual Property Rights, encompassing legal protections for creations of...
PDF
Mobility workshop of zju idi(l)
PDF
Agile Product Management - Co-Training with Angel Medinilla (c)
PPTX
Frameworks for Human-Centered Design
PDF
Detailed- Module 1-IPR notes (1).pdf and for business Studies
PPTX
HCI - 5-6 -Design Process Interaksi Manusi Komputer.pptx
PDF
Driving UX, Design, & Development collaboratively through the Enterprise
PPTX
Design Process for design students(NIFT,NID,FDDI,PEARL,IIT IDC,etc.)
PPT
A pencil in the global economy
PDF
Google Product Development Process
PPTX
Human Centered Design By Gnanasambandham
PPTX
Human Centered Design by SAMMIEE (Service to Humanity)
PDF
Swoon Editions Winning Product Selection Project
PDF
Agile Kaizen: Agile Product Management - Course Slides
PPT
Jeds 09 Iiu Prez 20090214 Final
PDF
Making Ideas Happen workshop for Vicsport
PDF
Audience Research on a Dime - Nonprofit of Influence
Peter Shanley, Principal & Evangelist at Neo
Barbara cruz see4334 2017
Polychrome Testing: Ideas & Practices to Improve Software Testing | QASymphon...
Intellectual Property Rights, encompassing legal protections for creations of...
Mobility workshop of zju idi(l)
Agile Product Management - Co-Training with Angel Medinilla (c)
Frameworks for Human-Centered Design
Detailed- Module 1-IPR notes (1).pdf and for business Studies
HCI - 5-6 -Design Process Interaksi Manusi Komputer.pptx
Driving UX, Design, & Development collaboratively through the Enterprise
Design Process for design students(NIFT,NID,FDDI,PEARL,IIT IDC,etc.)
A pencil in the global economy
Google Product Development Process
Human Centered Design By Gnanasambandham
Human Centered Design by SAMMIEE (Service to Humanity)
Swoon Editions Winning Product Selection Project
Agile Kaizen: Agile Product Management - Course Slides
Jeds 09 Iiu Prez 20090214 Final
Making Ideas Happen workshop for Vicsport
Audience Research on a Dime - Nonprofit of Influence

More from Sónia (18)

PPSX
MGA 673 – Evaluating User Experience (part1)
PPTX
Ifi7184 lesson6
PPTX
Ifi7174 lesson1
PPTX
Developing Interactive systems - lesson 2
PPTX
Ifi7184.DT lesson 2
PPTX
IFI7184.DT lesson1- Programming languages
PPTX
IFI7184.DT about the course
PPTX
Comparative evaluation
PPTX
Hcc lesson7
PPTX
Hcc lesson6
PPTX
eduHcc lesson2-3
PPTX
Human Centered Computing (introduction)
PPTX
A design space for Trust-enabling Interaction Design
PPTX
20 06-2014
PPTX
Ifi7155 project-final
PPTX
Sousa, Sonia; Lamas, David; Dias, Paulo (2012). The Implications of Trust on ...
PPTX
Workshop 1 (analysis and Presenting)
PPTX
Workshop 1 - User eXperience evaluation
MGA 673 – Evaluating User Experience (part1)
Ifi7184 lesson6
Ifi7174 lesson1
Developing Interactive systems - lesson 2
Ifi7184.DT lesson 2
IFI7184.DT lesson1- Programming languages
IFI7184.DT about the course
Comparative evaluation
Hcc lesson7
Hcc lesson6
eduHcc lesson2-3
Human Centered Computing (introduction)
A design space for Trust-enabling Interaction Design
20 06-2014
Ifi7155 project-final
Sousa, Sonia; Lamas, David; Dias, Paulo (2012). The Implications of Trust on ...
Workshop 1 (analysis and Presenting)
Workshop 1 - User eXperience evaluation

Recently uploaded (20)

PDF
LIFE & LIVING TRILOGY- PART (1) WHO ARE WE.pdf
PDF
LIFE & LIVING TRILOGY - PART - (2) THE PURPOSE OF LIFE.pdf
PDF
advance database management system book.pdf
PPTX
Education and Perspectives of Education.pptx
PDF
BP 704 T. NOVEL DRUG DELIVERY SYSTEMS (UNIT 1)
PDF
ChatGPT for Dummies - Pam Baker Ccesa007.pdf
PDF
David L Page_DCI Research Study Journey_how Methodology can inform one's prac...
PDF
BP 505 T. PHARMACEUTICAL JURISPRUDENCE (UNIT 2).pdf
PDF
Uderstanding digital marketing and marketing stratergie for engaging the digi...
PDF
LEARNERS WITH ADDITIONAL NEEDS ProfEd Topic
PPTX
Core Concepts of Personalized Learning and Virtual Learning Environments
PDF
Empowerment Technology for Senior High School Guide
PDF
Τίμαιος είναι φιλοσοφικός διάλογος του Πλάτωνα
PDF
Hazard Identification & Risk Assessment .pdf
PDF
What if we spent less time fighting change, and more time building what’s rig...
PDF
Race Reva University – Shaping Future Leaders in Artificial Intelligence
PDF
English Textual Question & Ans (12th Class).pdf
PPTX
Module on health assessment of CHN. pptx
PDF
Journal of Dental Science - UDMY (2021).pdf
DOCX
Cambridge-Practice-Tests-for-IELTS-12.docx
LIFE & LIVING TRILOGY- PART (1) WHO ARE WE.pdf
LIFE & LIVING TRILOGY - PART - (2) THE PURPOSE OF LIFE.pdf
advance database management system book.pdf
Education and Perspectives of Education.pptx
BP 704 T. NOVEL DRUG DELIVERY SYSTEMS (UNIT 1)
ChatGPT for Dummies - Pam Baker Ccesa007.pdf
David L Page_DCI Research Study Journey_how Methodology can inform one's prac...
BP 505 T. PHARMACEUTICAL JURISPRUDENCE (UNIT 2).pdf
Uderstanding digital marketing and marketing stratergie for engaging the digi...
LEARNERS WITH ADDITIONAL NEEDS ProfEd Topic
Core Concepts of Personalized Learning and Virtual Learning Environments
Empowerment Technology for Senior High School Guide
Τίμαιος είναι φιλοσοφικός διάλογος του Πλάτωνα
Hazard Identification & Risk Assessment .pdf
What if we spent less time fighting change, and more time building what’s rig...
Race Reva University – Shaping Future Leaders in Artificial Intelligence
English Textual Question & Ans (12th Class).pdf
Module on health assessment of CHN. pptx
Journal of Dental Science - UDMY (2021).pdf
Cambridge-Practice-Tests-for-IELTS-12.docx

Workshop 1

  • 1. Evaluating the User Experience Sónia Sousa & Mati Mõttus
  • 3. 6 Thinking Hats Edward De Bono’s Team Discussion Method ixdworks.com
  • 6. For example... ...we have an idea to run a restaurant
  • 7. White Hat: “What do we know about this area? What is situation on the market? What are the statistics that we are aware about? What is the information that is currently lacking and we need to do a research for?”
  • 8. Yellow Hat: “There is a free spot on the market for vegan cuisine! City council has launched a program of supporting new healthy-dining spots! We have a great team and we can make it work!”
  • 9. Green Hat: “We can add a hotel to the restaurant to get additional profit. We can buy an old building and re-construct it ourselves to save some money. We can cooperate with local farmers and get fresh fruits and vegetables”
  • 10. Black Hat: “There is already a lot of restaurants in the city. Because of cold climate restaurant will be very dependant on imported fruits and vegetables. Adding hotel will demand hiring more people = spend more. People of older age do not use social media, so only teenagers will know about us”
  • 11. Red Hat: “People love eating out because it saves time. People also love healthy food because it helps them to stay fit. People avoid vegan places because they have bad reputation. I have a feeling that we are going to succeed!”
  • 12. Blue Hat: “How would we present ourselves on the market? What is our target audience? Better option to run a property — rent it or buy it? Who will be recruiting staff members? What is the criteria? What is our agenda and end goal? How much time do we have for everything?”
  • 13. To do: ● Pick at least one hat ● During the session you can change hats, but 2 is a max. ● Try to avoid Black hat ● Make sure someone from your team wears Blue hat ixdworks.com
  • 16. Comparative evaluation • Evaluation of concepts: – Iterative product benchmarking • lab studies, before usage, UX experts • Aims of benchmarking – Mature own idea • Assess the competition • Seek inspiration • When to stop – When the resulting table is saturated (when adding new products does not bring added value) @ Sónia Sousa
  • 17. features Service 1 service 2 service 3 service 4 feature 1 x x x x feature 2 x feature 3 x x x feature 4 x x x x feature 5 x x x feature 6 x feature 7 x x feature 8 x feature 9 x feature 10 x feature 11 feature 12 feature 13 feature 14 The result @ Sónia Sousa Extra features
  • 18. Usability Study Scenario X type of usability metrics Task Success Task Time Errors Efficiency Learnability Issues base metrics Self-reported metrics Behavioral and physiological metrics Combined and comparative metrics Live Website metrics Card-sorting data Completing a transaction X X X X X Comparing products X X X X Evaluating frequent use of the same product X X X X X Evaluating navigation and information architecture X X X X Increasing awareness X X X Problem discovery X X Maximizing usability for a critical product X X X X Creating an overall positive user experience X Evaluating the impact of subtle changes X Comparing alternative designs X X X X @ Sónia Sousa
  • 20. • Write a 1000 characters blog post about the three articles on Google Drive – The aim is for you… • To compare the different approaches; and • To elaborate on which one you would personally select and use to evaluate the early concepts of your ongoing project. – Please see the course blog for more information. – The deadline is 28th of February. @ Sónia Sousa
  • 21. First reading assignment • Please see the course blog for more information – Remember this is a independent work assignment. – The deadline is 28th of February. @ Sónia Sousa