@jeroentjepkema
multichannel 2015
Fast, Responsive, Experiences
a.k.a. Design for First Impressions...
Part 1: Why should we care?
#mobilegeddon
Back to business...
...True intent conversion rate
0-0,5 0,5-1 1-1,5 1,5-2 2-2,5 2,5-3 3-3,5 3,5-4 4-5 5-6 6-7 7-8 8-9 9-10 >10
Conversionrate(%)
Categorienaam
Real User Monitoring: True Conversion Ratio
Data collected by MeasureWorks at various e-commerce websites using real user monitoring, reference: http://bit.ly/MW-VEUrum
0%
10%
Competitive Custom B2B
Real User Monitoring: True Conversion Ratio
Data collected by MeasureWorks at various e-commerce websites using real user monitoring, reference: http://bit.ly/MW-VEUrum
0%
10%
Optimal Conversion: 1,8s
0-0,5 0,5-1 1-1,5 1,5-2 2-2,5 2,5-3 3-3,5 3,5-4 4-5 5-6 6-7 7-8 8-9 9-10 >10
Conversionrate(%)
Categorienaam
Competitive Custom B2B
Real User Monitoring: True Conversion Ratio
Data collected by MeasureWorks at various e-commerce websites using real user monitoring, reference: http://bit.ly/MW-VEUrum
0%
10%
Optimal Conversion: 1,8s
LD50: 4,3s
0-0,5 0,5-1 1-1,5 1,5-2 2-2,5 2,5-3 3-3,5 3,5-4 4-5 5-6 6-7 7-8 8-9 9-10 >10
Conversionrate(%)
Categorienaam
Competitive Custom B2B
Real User Monitoring: True Conversion Ratio
Data collected by MeasureWorks at various e-commerce websites using real user monitoring, reference: http://bit.ly/MW-VEUrum
0%
10%
Optimal Conversion: 1,8s
LD50: 4,3s
Poverty Line: 7,6s
0-0,5 0,5-1 1-1,5 1,5-2 2-2,5 2,5-3 3-3,5 3,5-4 4-5 5-6 6-7 7-8 8-9 9-10 >10
Conversionrate(%)
Categorienaam
Competitive Custom B2B
On average a fast experience leads to a
4% higher true intent conversion rate...
That’s not my
website?
0
25
50
75
100
1 2 3 4 5
Slow Average Fast
%ofrespondentsthatratedtheactualwebsitespeed
Design score (1=bad - 5=beautiful)
60% of people ranked design
lower when they experienced a
slow website
Why should we care?
the WAITING experience
Source: Jakob Nielsen
0 0,5
Visual
confirmation
Source: Jakob Nielsen
the WAITING experience
0 0,5 1,5
Visual
confirmation
Understand
Navigation
Source: Jakob Nielsen
the WAITING experience
0 0,5 1,5 3
Visual
confirmation
Understand
Navigation
Relevant
Content?
Source: Jakob Nielsen
the WAITING experience
0 0,5 1,5 3 10
Visual
confirmation
Understand
Navigation
Relevant
Content?
Bye
Bye!
Source: Jakob Nielsen
the WAITING experience
http://amzn.to/1biSi6C
Offline vs. Online
Mobile moments?
“Both offline and online consumers
associate (slow) performance with
poor customer service”
Click away slidePerformance tolerance?
0
10
20
30
40
50
60
70
80
90
100
0 1 2 3 4 5 6 7 8 9 10
Bouncerate per pagetype/session
Bouncerate(%)
Page load time (sec.)
Median Campaign Product search
0
10
20
30
40
50
60
70
80
90
100
0 1 2 3 4 5 6 7 8 9 10
Bouncerate(%)
Page load time (sec.)
Median Campaign Product search
Bouncerate per pagetype/session
Queuing for iPhone6 launch - London 2014
Purpose vs. Context
Online users often lack context for delays...
...and see no other option than to click away
“Your website is at it’s best when
it creates the feeling that you don’t
have to work to achieve your goal”
Part 2: Design for fast experience
The Skip: http://musicmachinery.com/2014/05/02/the-skip/
“Hit them with a beat! The decision to continue
listening to a song is often determined in the first 10
seconds” - Dr. Dre, Source Magazine
The Skip: http://musicmachinery.com/2014/05/02/the-skip/
Current state of responsive web ;-(
WiFi 3G
Tested with webpagetest.org (WiFi (10Mbs down/1,5Mbs up), 4G (5Mbps Down, 1Mbps Up) & 3G (2000Kbps Down, 764Kbps Up))
Optimize for #mobilegeddon
Responsive & Fits on every screen
NO FLASH! EVER!
Eliminate faulty redirects...
Again... Speed!
Fixing vs. Designing
Search/Orientation phase
Perception of experience
1
Performance influence cycle
http://twinkle100.measureworks.nl
Delivered
experience
Your website
3
5
2
Stimulate content/
conversion
4
Performance influence cycle
Search/Orientation phase
Perception of experience
1
http://twinkle100.measureworks.nl
Eco System
of Me?
Your
BRAND
Eco System
of Me?
every
day
Flipboard
e-mail
Twitter
Fitbit
Foursquare
Human.co
facebook
twitter
linkedin
NBA.com
News
apps
Your
BRAND
Eco System
of Me?
every
week
every
day
Flipboard
e-mail
Netflix
Youtube
Twitter
Dropbox
Parkmobile
Soundcloud
Evernote
Fitbit
Foursquare
Human.co
whatsapp
Facetime
facebook
twitter
linkedin
NBA.com
News
apps
Your
BRAND
Eco System
of Me?
every
week
every
day
Flipboard
e-mail
Shazam
Google
Hangouts
Netflix
Youtube
Twitter
Dropbox
Parkmobile
Google
Plus
Soundcloud
Evernote
Google
Maps
Appie
Skype
Pathe
Youtube
Meetup
Fitbit
Foursquare
Human.co
whatsapp
Facetime
facebook
twitter
linkedin
NBA.com
News
apps
every
month
Your
BRAND
Eco System
of Me?
?
every
week
every
day
Flipboard
e-mail
shazam
Google
Hangouts
Netflix
Youtube
Twitter
Dropbox
Parkmobile
Google
Plus
Soundcloud
Evernote
Google
Maps
appie
Skype
Pathe
Youtube
Meetup
Fitbit
Foursquare
Human.co
whatsapp
Facetime
facebook
twitter
linkedin
NBA.com
every
month
Your
BRAND
Eco System
of Me?
Which order?
Product, Price, User Experience
5 fast design ‘hacks’ to avoid the (mobile) ‘skip’
1. Speed-up your perception
http://www.nytimes.com/2012/08/19/opinion/sunday/why-waiting-in-line-is-torture.html?pagewanted=all&_r=0
http://answers.yahoo.com/question/index?qid=1005081200005
nytimes.com/2004/02/27/nyregion/27BUTT.html
Which is faster?
Tested with webpagetest.org (WiFi (10Mbs down/1,5Mbs up), 4G (5Mbps Down, 1Mbps Up) & 3G (2000Kbps Down, 764Kbps Up))
Which is faster?
Tested with webpagetest.org (WiFi (10Mbs down/1,5Mbs up), 4G (5Mbps Down, 1Mbps Up) & 3G (2000Kbps Down, 764Kbps Up))
Which is faster?
Tested with webpagetest.org (WiFi (10Mbs down/1,5Mbs up), 4G (5Mbps Down, 1Mbps Up) & 3G (2000Kbps Down, 764Kbps Up))
Which is faster?
Tested with webpagetest.org (WiFi (10Mbs down/1,5Mbs up), 4G (5Mbps Down, 1Mbps Up) & 3G (2000Kbps Down, 764Kbps Up))
“The faster you can visualize your content,
the more engaged your visitors will become”
2. Defer non-priority content
Which contents loads in which order?
A: Load carousel first B: Delayed download
20% time spent on priority content 1% time spent on priority content
http://www.nngroup.com/articles/website-response-times/
83% of all Twinkle100 sites loads menu
before content...
“The faster you can paint your priority content,
the more engaged your visitors will become”
3. Sequencing
“Users might overlook things that change
too fast and/or often. Changeable screen
elements are harder to understand in a
limited timeframe”
Homepage Search
Product
overview
Product
Detail
Basket
Homepage Search
Product
overview
Product
Detail
Basket
Homepage Search
Product
overview
Product
Detail
Basket
Understand
navigation
(1-2 sec.)
Consistent
navigation
(0,5-1 sec.)
Renew your
orientation
(1-2 sec.)
renew
your navigation
(1-2 sec.)
Consistent
navigation
(0,5-1 sec.)
Consistent, simple & user generated navigation
Design your Carousel
Item 1 Item 2 Item 3 Item 4
Call to action ><
Descriptive labels
Buy me?
Arrows for navigation
direction
Item 1 Item 2 Item 3 Item 4
Call to action ><
Descriptive labels
Buy me?
Arrows for navigation
direction
Call to action first
Load other items
seperately, in the
background
Load only primary
image second
4. Increase perceived value
Homepage Search
Product
overview
Product
Detail
Payment
Tolerated
speed
Fast response = Fast Experience?
The kayak effect: http://bit.ly/UgTneD
People prefer to wait for up
to a minute to get what they
want from an app rather
than get it instantly – if, and
it’s an important if, they
believe the app is working
for them
http://www.fastcodesign.com/1669788/the-3-white-lies-behind-instagrams-lightning-speed
http://blog.placeit.net/ux-tactics-make-slow-things-seem-faster/
Show effort,
provide specific content,
build trust
5. Let the device work...
Make life easy, insert touch events...
Search
Touch gestures
Native gestures
Scrolling
Questions so far?
Part 3: Find out what works
Frictionless = Happy users
Frictionless = Reducing Complexity
Frictionless = Recognizable navigation
Frictionless = Fast delivery
Trouble is stickyness?
Gum/Shoe
Reaching stickeyness..
With modern day technologies it’s no longer IF
we can build, but if anyone will CARE...
That’s why we have to learn & adapt fast...
One Metric That Matters
Every website has goals
Your Analytics measures the
movement towards these goals
Importance of correlation vs. causation
1
100
10000
Jan Feb Mar Apr May Jun Jul Aug Sept Oct Nov Dec
Relation between Ice cream and drownings?
Ice cream consumption Drownings
http://www.flickr.com/photos/25159787@N07/3766111564
1
100
10000
Jan Feb Mar Apr May Jun Jul Aug Sept Oct Nov Dec
Relation between Ice cream and drownings?
Ice cream consumption Drownings
http://www.flickr.com/photos/25159787@N07/3766111564
1
100
10000
Jan Feb Mar Apr May Jun Jul Aug Sept Oct Nov Dec
True causality
Ice cream consumption Drownings Temperature
Holy causation, Batman...
A leading, causal, connection is
the analytics superpower...
That’s why we need to pick one at at time...
Landing page design A/B testing
Cohort analysis General analytics
URL shortening
Funnel analytics
Influencer Marketing
Publisher analytics
SaaS analytics
Gaming analytics
User interaction Customer satisfaction KPI dashboardsUser segmentation
User analytics Spying on users
Predicting downtime
Challenge: Can we predict downtime?
0
15
30
45
60
0 5 10 15 20 25 30 35 40 45 50 55 60
#pageviews
Example downtime pattern
Min/Hour
0
15
30
45
60
0 5 10 15 20 25 30 35 40 45 50 55 60
Regular operations
#pageviews
Example downtime pattern
Min/Hour
0
15
30
45
60
0 5 10 15 20 25 30 35 40 45 50 55 60
Regular operations
News
papers
#pageviews
Example downtime pattern
Min/Hour
0
15
30
45
60
0 5 10 15 20 25 30 35 40 45 50 55 60
Regular operations
News
papers
Alerts?
#pageviews
Example downtime pattern
Min/Hour
0
15
30
45
60
0 5 10 15 20 25 30 35 40 45 50 55 60
Regular operations
News
papers
Alerts? Downtime
#pageviews
Example downtime pattern
Min/Hour
Min/Hour
#pageviews
0
15
30
45
60
0 5 10 15 20 25 30 35 40 45 50 55 60
Regular operations
News
papers
Alerts? Downtime
Example downtime pattern
This is where we need to be!
Min/Hour
#pageviews
0
15
30
45
60
0 5 10 15 20 25 30 35 40 45 50 55 60
Regular operations
News
papers
Alerts? Downtime
2.
Social
Media
This is where we need to be!
1.
Click
Behavior
Example downtime pattern
Min/Hour
Step 1: Patterns in Client Behavior?
Clickpath prediction
Step 2: Detection
How fast do I need to be?
Step 3: False positives?
+ = Predicting downtime?
Sentiment Profile Behavior
0
15
30
45
60
0 5 10 15 20 25 30 35 40 45 50 55 60
Test results
(Data derived from incident analysis of 3 websites, across a period of 4 months.
Data points matched (manually) over time period, per incident)
Time period in which we can detect a persistent
change in pattern per type of monitoring
0
15
30
45
60
0 5 10 15 20 25 30 35 40 45 50 55 60
Social Alerting
Change in click behavior
Performance
alerting
Example downtime pattern
Your mileage may vary... for now, type of incident
determines predictive nature
3 types of data:
Which pages are clicked on?
How fast is it on every device?
Which elements do they click on?
Synthetic
Benchmark
Go check your site @
Webpagetest.org
(For settings: Akamai State of the Internet)
Real User monitoring
1
Insert tag (.js file) into
(mobile) web pages
Pages are requested
from browser/device
As pages execute,
tag collects
performance metrics
After onload tag send
detailed report for
further analysis
tag.js
tag.js
tag.js
tag.js
2 3 4
Top 5 DESKTOPTop 5 DESKTOPTop 5 DESKTOP
Top Browser type Bouncerate avg. Back-End Time avg. Front-End time Total avg. load time
1 Chrome30 49% 0.26 1.31 1.61
2 IE10 51% 0.27 0.81 1.18
3 Firefox25 48% 0.35 1.42 1.88
4 IE9 51% 0.27 1.26 1.61
5 Mobile Safari7 48% 0.52 1.86 2.79
Top 5 MOBILETop 5 MOBILETop 5 MOBILE
Browser type Bouncerate Backend Time FrontEnd time Loadtime
1 Android 4 72% 0.27 2.38 2.64
2 Mobile Safari 7 53% 0.93 1.04 2.58
3 Chrome Mobile 30 75% 0.40 1.19 1.99
4 Chrome Mobile 18 82% 0.41 1.53 2.25
5 Android 2 59% 0.72 1.88 3.05
Browsers, usage, performance...
Heatmapping
Where do you click to book a hotel?
As designed Homepage Last Minute
Product type
Destination
Preferences
Departure
Search?
Free search?
+ =
Real
User
Monitoring
Heat
mapping
Money
in the bank
Are you #fast enough?
http://webpagetest.org
http://benchmark.measureworks.nl
Quick links
Measure Performance:
Google Analytics Site speed: http://bit.ly/1ivGWTt
Soast mPulse: http://bit.ly/I5ngs8
Webpagetest: www.webpagetest.org
Optimize performance:
Yslow: yslow.org
GTmetrix: gtmetrix.com
Google Pagespeed tools: https://developers.google.com/speed/pagespeed/
What’s your time to first tweet?
https://blog.twitter.com/2012/improving-performance-on-twittercom
Defining Service Levels
First, establish a baseline:
A pre-defined set of metrics
First, establish a baseline:
A pre-defined set of metrics
that describes normal behavior
First, establish a baseline:
A pre-defined set of metrics
that describes normal behavior
in order to detect variancies
First, establish a baseline:
and to be comparable within historic context
A pre-defined set of metrics
that describes normal behavior
in order to detect variancies
First, establish a baseline:
A practical (and easy DIY) example:
Service Window
Purchasing a bed,
must be completed (speed),
where every page loads under 3 sec.,
from any location in the Netherlands,
for 95% of all users,
every 5 minutes between 6am and 12pm,
using IE9 and higher,
Customer journey
Metric: Speed
Target: Sec
User scenario
User locations
Percentile
measured with Synthetic Monitoring. Monitoring type
Business
Performance
Repeatable, End-User focused & Quantifiable
Performance SLA for Bol.com
Data presented by MeasureWorks at Velocity Conference London 2013: http://bit.ly/MW-VEUrum
0
12,5
25
37,5
50
62,5
75
87,5
100
0-0,5 0,5-1 1-1,5 1,5-2 2-2,5 2,5-3 3-3,5 3,5-4 4-5 5-6 6-7 7-8 8-9 9-10 >10
Non-Bouncerate(%)
Categorienaam
Pageviews(#)
Bouncerate # Pageviews
Bol.com: Speed vs. Engagement per month
0
12,5
25
37,5
50
62,5
75
87,5
100
0-0,5 0,5-1 1-1,5 1,5-2 2-2,5 2,5-3 3-3,5 3,5-4 4-5 5-6 6-7 7-8 8-9 9-10 >10
Non-Bouncerate(%)
Categorienaam
Pageviews(#)
Bouncerate # Pageviews
Bol.com: Speed vs. Engagement per month
Non-Bounce Mobile
LD50: 4.85 sec.
Baseline: 2,7 sec.
Poverty Line: 10,6 sec.
Data presented by MeasureWorks at Velocity Conference London 2013: http://bit.ly/MW-VEUrum
...experiment till you find what
moves the needle
Validating experiments:
B.R.A.S.S. framework
Blink Relevance Availability Scalability Sum
Blink Relevance Availability Scalability Sum
5-second rule
Gut feeling
Instinct score
Don’t overthink it
Blink Relevance Availability Scalability Sum
5-second rule
Gut feeling
Instinct score
Don’t overthink it
Do we have the
available
resources?
Do we have the
skills?
Do we have the
tools?
Is it expensive?
Blink Relevance Availability Scalability Sum
5-second rule
Gut feeling
Instinct score
Don’t overthink it
Is this Channel
relevant to your
product/service?
Does your
audience hang out
on this channel?
Can you target
them effectively?
Do we have the
available
resources?
Do we have the
skills?
Do we have the
tools?
Is it expensive?
Blink Relevance Availability Scalability Sum
5-second rule
Gut feeling
Instinct score
Don’t overthink it
Is this Channel
relevant to your
product/service?
Does your
audience hang out
on this channel?
Can you target
them effectively?
Do we have the
available
resources?
Do we have the
skills?
Do we have the
tools?
Is it expensive?
How scalable is
this channel?
Can we easily
increase it?
Law of diminishing
returns
Blink Relevance Availability Scalability Sum
5-second rule
Gut feeling
Instinct score
Don’t overthink it
Is this Channel
relevant to your
product/service?
Does your
audience hang out
on this channel?
Can you target
them effectively?
Do we have the
available
resources?
Do we have the
skills?
Do we have the
tools?
Is it expensive?
How scalable is
this channel?
Can we easily
increase it?
Law of diminishing
returns
1-5 1-5 1-5 1-5 BRASS score
bit.ly/brassframework
Iz overwhelmed?
Thanks! More questions?
M: jtjepkema@measureworks.nl
T: @jeroentjepkema
W: www.measureworks.nl
View slides: bit.ly/MW-SCL15

MeasureWorks - Design for Fast Experiences (Startup session).key