Changing the 
business of 
testing 
Vasco Duarte 
(cc) https://www.flickr.com/photos/nattu
Vasco Duarte 
@duarte_vasco 
http://bit.ly/vasco_blog 
http://bit.ly/vasco_slideshare 
http://NoEstimatesBook.com 
Vasco.Duarte@oikosofy.com
Act I – The problem
Changing business of testing - Testing Assembly Helsinki 2014
~16 000€ / Year 
Average Software Engineer salary in China 
Source: http://bit.ly/china_pay
~5 000€ / Year 
Average Software Engineer salary in Vietnam 
Source: http://bit.ly/vietnam_pay
~18 000€ / Year 
Average Software Engineer salary in Portugal 
Source: http://bit.ly/portugal_pay
Changing business of testing - Testing Assembly Helsinki 2014
~54 000€ / Year 
Average IT salary, TTL ry 2013 data 
Source: hthttp://bit.ly/finland_ttl_pay
Up to 10 times higher!
€ 
Cost Productivity 
€ 
How ?
Problems cannot be solved by 
the same level of thinking that 
created them 
Paraphrasing a quote from Einstein
We need a paradigm shift! 
How can we achieve it?
Changing business of testing - Testing Assembly Helsinki 2014
Act II – Why do we get poor 
results?
Changing business of testing - Testing Assembly Helsinki 2014
Pain
1. Customer need 
2. Product 
managers 
3. Business 
analyst 
…
5. Designers / 
Programmers 
4a. Designers / Architects 
4b. Test designer 
… 
… 
6. Testers 
…
Chronic Pain!
Analytical design - prototype 
Silo 1 Silo 2 Silo 3 
Business Knowledge Execution Knowledge Actual execution
Silo design leads to 
ineffective processes. A 
story…
Trying to 
reduce costs 
with analytical 
mindset 
= 
Drive costs 
up!
You know who tests your 
software, but who tests 
your business decisions?
Act III – The solution: a 
paradigm shift!
Changing business of testing - Testing Assembly Helsinki 2014
1. Create constancy of purpose towards 
improvement 
Replace short-term reaction with long-term planning 
2. Management must adopt the new 
philosophy 
The implication is that management should actually adopt his 
philosophy, rather than merely expect the workforce to do so 
3. Cease dependence on inspection 
The implication is that we must relentlessly remove the root causes for 
defects rather than inspecting them out of the final product 
4. Move towards a single supplier for any one 
item 
Multiple suppliers mean variation in the quality of work as well as lost 
knowledge in hand-over 
5. Improve constantly and forever 
Constantly strive to improve how you work, focusing on the purpose 
rather than short term perspectives only. 
6. Institute training on the job 
If people are not trained properly they will not all work in a consistent 
way. This leads to defects, mis-communication, etc. 
7. Institute Leadership 
Deming makes a distinction between Leadership and mere 
Supervision. “Banish targets, substitute leadership” Deming used to 
say 
8. Drive out fear 
Management by fear is counter-productive because it prevents 
workers from acting the best interest of the organisation 
9. Break down barriers between departments 
Each department servers not the management but the needs from 
other departments that use its outputs. 
10. Eliminate slogans 
It is not the people who make mistakes (in 95% of the cases). It is the 
process. Slogans do not help improve processes and harass the people 
doing the actual work! 
11. Eliminate management by objectives 
Production targets subvert the system. Workers start working for the 
targets instead of working for the purpose of the organization. Metrics: 
yes, targets: no! 
12. Remove barriers to pride of workmanship 
Many of the other problems outlined above reduce worker satisfaction 
and therefore reduce focus on quality 
13. Institute education and self-improvement 
A result of pride of craftsmanship is the desire to learn and improve. 
This, in turn leads to better quality. 
14. The transformation is everyone’s job 
It is manager’s job to lead, but it is everyone’s job to contribute to the 
needed transformation of our business.
3. Cease dependence on inspection 
The implication is that we must relentlessly remove 
the root causes for defects rather than inspecting 
them out of the final product 
9. Break down barriers between 
departments 
Each department servers not the management but 
the needs from other departments that use its 
outputs.
Changing business of testing - Testing Assembly Helsinki 2014
In other words…
1. Customer need 
2. Product 
managers 
Co-operation 
Colaboration … 
2. Business 
analyst and… 
4. Testers
3. Testers 
Co-operation 
Colaboration 
… 
3. Business 
analyst 
3. Test designer and… 
3. Designers / 
Programmers 
4. Testers 
Co-operation 
Colaboration 
4. Designers / 
Programmers 
…
Your 
product 
rockz! 
Happy(!) Customer
Act IV – The action plan
€ 
Cost Productivity 
€ 
Paradigm 
shift!
Organize your process around 
your customer need, not your 
silo-based organization
You can start today by applying 
the following principles
3. Cease dependence on inspection 
The implication is that we must relentlessly remove 
the root causes for defects rather than inspecting 
them out of the final product 
9. Break down barriers between 
departments 
Each department servers not the management but 
the needs from other departments that use its 
outputs.
Later you can apply the other 
12…
Recommended reading 
Interesting links 
Reading 
Deming, Out of the Crisis 
Reinertsen, Flow in product development 
Video on a different paradigm for process 
design: 
Systems thinking intro, http://bit.ly/systems_video 
This presentation: 
www.slideshare.com/duarte_vasco
About the speaker: 
@duarte_vasco 
http://bit.ly/vasco_blog 
http://bit.ly/vasco_slideshare 
http://NoEstimatesBook.com 
Vasco.Duarte@oikosofy.com

More Related Content

PPTX
Cobis and Oikosofy 5 Innovation shots for the banking industry
ODP
Agile localization as a business advantage workshop
PPTX
Agile Metrics 101
PPTX
No estimates - 10 new principles for testing
PDF
Managing Work
PDF
Introduction
PDF
Release Planning
PDF
Continuous Improvement
Cobis and Oikosofy 5 Innovation shots for the banking industry
Agile localization as a business advantage workshop
Agile Metrics 101
No estimates - 10 new principles for testing
Managing Work
Introduction
Release Planning
Continuous Improvement

What's hot (20)

PDF
Managing Teams
PDF
"Hack Your Project" by Andrea Fryrear and David Lesue
PPTX
Change How You Do Product - by Tal Ben-Simon (ProductX 2018)
PDF
The #NoEstimates Debate
PDF
User Research
PDF
Experimental Product Development
PPTX
Great! another bug
PPT
Building Debt Free MVP - Deep Dive
PDF
10 Tactics for Building an Optimization Culture
PDF
What does it mean to be a test engineer?
PPT
Software Project Estimation Survival Guide
PPTX
Dave West (Tasktop Technologies) - Wizard of Oz
PPT
[DevDay2019] Why you'll lose without UX Design - By Szilard Toth, CTO at e·pi...
PPTX
Doing agile with an ISO-20000 Telco (AgilePT 2015)
PDF
The Role of the Product Manager
PDF
[DevDay2019] Lean UX - By Bryant Castro, Bryant Castro at Wizeline
PPTX
Eric Ries Lean Startup Presentation For Web 2.0 Expo April 1 2009 A Disciplin...
PDF
How we built Talentpioneer by Productsquads
PDF
Id camp x dicoding live : persiapan jadi software engineer hebat 101
PPTX
Lean startup
Managing Teams
"Hack Your Project" by Andrea Fryrear and David Lesue
Change How You Do Product - by Tal Ben-Simon (ProductX 2018)
The #NoEstimates Debate
User Research
Experimental Product Development
Great! another bug
Building Debt Free MVP - Deep Dive
10 Tactics for Building an Optimization Culture
What does it mean to be a test engineer?
Software Project Estimation Survival Guide
Dave West (Tasktop Technologies) - Wizard of Oz
[DevDay2019] Why you'll lose without UX Design - By Szilard Toth, CTO at e·pi...
Doing agile with an ISO-20000 Telco (AgilePT 2015)
The Role of the Product Manager
[DevDay2019] Lean UX - By Bryant Castro, Bryant Castro at Wizeline
Eric Ries Lean Startup Presentation For Web 2.0 Expo April 1 2009 A Disciplin...
How we built Talentpioneer by Productsquads
Id camp x dicoding live : persiapan jadi software engineer hebat 101
Lean startup
Ad

Viewers also liked (13)

PPTX
Vasco duarte - agile R&D - scrum gathering lisbon 2011
PPTX
We need proof! - Talk at Agile Estonia's Agile Saturday
PDF
LKNL12: Kanban for the whole value stream
PPTX
Agile Scales, Waterfall Doesn't
PPTX
Agile is easy! It's making it work with your business that is hard
ODP
Story Points considered harmful – a new look at estimation techniques
PPTX
No estimates - a controversial way to improve estimation with results-handouts
PPTX
Story points considered harmful - or why the future of estimation is really i...
PPTX
From an Idea to a Vision you can implement - Vision workshop
PPTX
Oikosofy - The User Story mapping workshop - facilitator's guide
PPTX
Business Agility - taking advantage of an agile R&D
PPTX
A paradigm shift for testing - how to increase productivity 10x!
PPTX
Patterns of agility, how to recognize and agile project when you see one
Vasco duarte - agile R&D - scrum gathering lisbon 2011
We need proof! - Talk at Agile Estonia's Agile Saturday
LKNL12: Kanban for the whole value stream
Agile Scales, Waterfall Doesn't
Agile is easy! It's making it work with your business that is hard
Story Points considered harmful – a new look at estimation techniques
No estimates - a controversial way to improve estimation with results-handouts
Story points considered harmful - or why the future of estimation is really i...
From an Idea to a Vision you can implement - Vision workshop
Oikosofy - The User Story mapping workshop - facilitator's guide
Business Agility - taking advantage of an agile R&D
A paradigm shift for testing - how to increase productivity 10x!
Patterns of agility, how to recognize and agile project when you see one
Ad

Similar to Changing business of testing - Testing Assembly Helsinki 2014 (20)

PPT
Deming's 14 points
PDF
14 Ideas from a Really Smart Guy on How to Manage Better - Hospitality Edition!
DOCX
9MGMT640-1601B-01Roderick Deon GoodrumWendy Arrignton.docx
DOCX
Inspection and qc 1
PPT
Demings philosophy in Total quality .ppt
DOCX
Research2
PPT
Anatomy of Strategic Quality Managment
PPTX
PPTX
Quality Management
PDF
TQM Leadership
PDF
42 deming's 14 points
PDF
Qc11....vivek patel
PPT
Tqm points
PPTX
Deming’s 14 Points on Total Quality Management - TQM - W. Edwards Deming
PPT
PDF
Quality in the Workplace: W. Edwards Deming's 14 key principles
PPTX
Deming, Crosby, Juran quality improvement principles.
PPTX
Deming’s 14 Points for Management
PPT
Deming’s 14th philosophy
Deming's 14 points
14 Ideas from a Really Smart Guy on How to Manage Better - Hospitality Edition!
9MGMT640-1601B-01Roderick Deon GoodrumWendy Arrignton.docx
Inspection and qc 1
Demings philosophy in Total quality .ppt
Research2
Anatomy of Strategic Quality Managment
Quality Management
TQM Leadership
42 deming's 14 points
Qc11....vivek patel
Tqm points
Deming’s 14 Points on Total Quality Management - TQM - W. Edwards Deming
Quality in the Workplace: W. Edwards Deming's 14 key principles
Deming, Crosby, Juran quality improvement principles.
Deming’s 14 Points for Management
Deming’s 14th philosophy

More from Vasco Duarte (6)

PPTX
What is an enterprise agile coach - Main skills, responsibilities and helpful...
PPTX
A quick trip to the future land of no estimates
PPTX
Agile Innovation - Product Management in Turbulent times
PDF
Agile Beyond the Hype! – What You Really Need to Know Before You Jump In
PDF
Agile patterns in the real world
PPTX
Agile scales, waterfall doesn't - Scrum Gathering Lisbon
What is an enterprise agile coach - Main skills, responsibilities and helpful...
A quick trip to the future land of no estimates
Agile Innovation - Product Management in Turbulent times
Agile Beyond the Hype! – What You Really Need to Know Before You Jump In
Agile patterns in the real world
Agile scales, waterfall doesn't - Scrum Gathering Lisbon

Recently uploaded (20)

PDF
Decision Optimization - From Theory to Practice
PDF
zbrain.ai-Scope Key Metrics Configuration and Best Practices.pdf
PDF
The AI Revolution in Customer Service - 2025
PDF
Data Virtualization in Action: Scaling APIs and Apps with FME
PDF
Planning-an-Audit-A-How-To-Guide-Checklist-WP.pdf
PDF
The-2025-Engineering-Revolution-AI-Quality-and-DevOps-Convergence.pdf
PDF
4 layer Arch & Reference Arch of IoT.pdf
PDF
A symptom-driven medical diagnosis support model based on machine learning te...
PDF
Aug23rd - Mulesoft Community Workshop - Hyd, India.pdf
PDF
The-Future-of-Automotive-Quality-is-Here-AI-Driven-Engineering.pdf
PPTX
AI-driven Assurance Across Your End-to-end Network With ThousandEyes
PDF
Dell Pro Micro: Speed customer interactions, patient processing, and learning...
PPTX
Build automations faster and more reliably with UiPath ScreenPlay
PDF
ment.tech-Siri Delay Opens AI Startup Opportunity in 2025.pdf
PDF
Rapid Prototyping: A lecture on prototyping techniques for interface design
PDF
AI.gov: A Trojan Horse in the Age of Artificial Intelligence
PDF
Co-training pseudo-labeling for text classification with support vector machi...
PDF
IT-ITes Industry bjjbnkmkhkhknbmhkhmjhjkhj
PDF
A hybrid framework for wild animal classification using fine-tuned DenseNet12...
PDF
substrate PowerPoint Presentation basic one
Decision Optimization - From Theory to Practice
zbrain.ai-Scope Key Metrics Configuration and Best Practices.pdf
The AI Revolution in Customer Service - 2025
Data Virtualization in Action: Scaling APIs and Apps with FME
Planning-an-Audit-A-How-To-Guide-Checklist-WP.pdf
The-2025-Engineering-Revolution-AI-Quality-and-DevOps-Convergence.pdf
4 layer Arch & Reference Arch of IoT.pdf
A symptom-driven medical diagnosis support model based on machine learning te...
Aug23rd - Mulesoft Community Workshop - Hyd, India.pdf
The-Future-of-Automotive-Quality-is-Here-AI-Driven-Engineering.pdf
AI-driven Assurance Across Your End-to-end Network With ThousandEyes
Dell Pro Micro: Speed customer interactions, patient processing, and learning...
Build automations faster and more reliably with UiPath ScreenPlay
ment.tech-Siri Delay Opens AI Startup Opportunity in 2025.pdf
Rapid Prototyping: A lecture on prototyping techniques for interface design
AI.gov: A Trojan Horse in the Age of Artificial Intelligence
Co-training pseudo-labeling for text classification with support vector machi...
IT-ITes Industry bjjbnkmkhkhknbmhkhmjhjkhj
A hybrid framework for wild animal classification using fine-tuned DenseNet12...
substrate PowerPoint Presentation basic one

Changing business of testing - Testing Assembly Helsinki 2014

  • 1. Changing the business of testing Vasco Duarte (cc) https://www.flickr.com/photos/nattu
  • 2. Vasco Duarte @duarte_vasco http://bit.ly/vasco_blog http://bit.ly/vasco_slideshare http://NoEstimatesBook.com [email protected]
  • 3. Act I – The problem
  • 5. ~16 000€ / Year Average Software Engineer salary in China Source: http://bit.ly/china_pay
  • 6. ~5 000€ / Year Average Software Engineer salary in Vietnam Source: http://bit.ly/vietnam_pay
  • 7. ~18 000€ / Year Average Software Engineer salary in Portugal Source: http://bit.ly/portugal_pay
  • 9. ~54 000€ / Year Average IT salary, TTL ry 2013 data Source: hthttp://bit.ly/finland_ttl_pay
  • 10. Up to 10 times higher!
  • 12. Problems cannot be solved by the same level of thinking that created them Paraphrasing a quote from Einstein
  • 13. We need a paradigm shift! How can we achieve it?
  • 15. Act II – Why do we get poor results?
  • 17. Pain
  • 18. 1. Customer need 2. Product managers 3. Business analyst …
  • 19. 5. Designers / Programmers 4a. Designers / Architects 4b. Test designer … … 6. Testers …
  • 21. Analytical design - prototype Silo 1 Silo 2 Silo 3 Business Knowledge Execution Knowledge Actual execution
  • 22. Silo design leads to ineffective processes. A story…
  • 23. Trying to reduce costs with analytical mindset = Drive costs up!
  • 24. You know who tests your software, but who tests your business decisions?
  • 25. Act III – The solution: a paradigm shift!
  • 27. 1. Create constancy of purpose towards improvement Replace short-term reaction with long-term planning 2. Management must adopt the new philosophy The implication is that management should actually adopt his philosophy, rather than merely expect the workforce to do so 3. Cease dependence on inspection The implication is that we must relentlessly remove the root causes for defects rather than inspecting them out of the final product 4. Move towards a single supplier for any one item Multiple suppliers mean variation in the quality of work as well as lost knowledge in hand-over 5. Improve constantly and forever Constantly strive to improve how you work, focusing on the purpose rather than short term perspectives only. 6. Institute training on the job If people are not trained properly they will not all work in a consistent way. This leads to defects, mis-communication, etc. 7. Institute Leadership Deming makes a distinction between Leadership and mere Supervision. “Banish targets, substitute leadership” Deming used to say 8. Drive out fear Management by fear is counter-productive because it prevents workers from acting the best interest of the organisation 9. Break down barriers between departments Each department servers not the management but the needs from other departments that use its outputs. 10. Eliminate slogans It is not the people who make mistakes (in 95% of the cases). It is the process. Slogans do not help improve processes and harass the people doing the actual work! 11. Eliminate management by objectives Production targets subvert the system. Workers start working for the targets instead of working for the purpose of the organization. Metrics: yes, targets: no! 12. Remove barriers to pride of workmanship Many of the other problems outlined above reduce worker satisfaction and therefore reduce focus on quality 13. Institute education and self-improvement A result of pride of craftsmanship is the desire to learn and improve. This, in turn leads to better quality. 14. The transformation is everyone’s job It is manager’s job to lead, but it is everyone’s job to contribute to the needed transformation of our business.
  • 28. 3. Cease dependence on inspection The implication is that we must relentlessly remove the root causes for defects rather than inspecting them out of the final product 9. Break down barriers between departments Each department servers not the management but the needs from other departments that use its outputs.
  • 31. 1. Customer need 2. Product managers Co-operation Colaboration … 2. Business analyst and… 4. Testers
  • 32. 3. Testers Co-operation Colaboration … 3. Business analyst 3. Test designer and… 3. Designers / Programmers 4. Testers Co-operation Colaboration 4. Designers / Programmers …
  • 33. Your product rockz! Happy(!) Customer
  • 34. Act IV – The action plan
  • 35. € Cost Productivity € Paradigm shift!
  • 36. Organize your process around your customer need, not your silo-based organization
  • 37. You can start today by applying the following principles
  • 38. 3. Cease dependence on inspection The implication is that we must relentlessly remove the root causes for defects rather than inspecting them out of the final product 9. Break down barriers between departments Each department servers not the management but the needs from other departments that use its outputs.
  • 39. Later you can apply the other 12…
  • 40. Recommended reading Interesting links Reading Deming, Out of the Crisis Reinertsen, Flow in product development Video on a different paradigm for process design: Systems thinking intro, http://bit.ly/systems_video This presentation: www.slideshare.com/duarte_vasco
  • 41. About the speaker: @duarte_vasco http://bit.ly/vasco_blog http://bit.ly/vasco_slideshare http://NoEstimatesBook.com [email protected]

Editor's Notes

  • #41: a) cease dependency on inspections b) break down barriers between departments And with these alone you can create a process that will be 10 times more effective!