Download to read offline
Uploaded byBerk Dülger
TestCon2018 - Next Generation Testing in the Age of Machines
The document discusses the evolution of testing practices in response to technological advancements and organizational changes, emphasizing proactive approaches, adaptation to change, and the importance of leadership and collaboration. It highlights trends such as DevOps, continuous testing, and the integration of artificial intelligence in software testing. The author provides case studies illustrating how teams adapted by encouraging innovation, reducing stress through metrics, and participating in new technologies like robotic process automation.
More Related Content
Similar to TestCon2018 - Next Generation Testing in the Age of Machines
![[QE 2018] Paul Gerrard – Automating Assurance: Tools, Collaboration and DevOps](https://cdn.slidesharecdn.com/ss_thumbnails/automatingassurancegerrard-180629130855-thumbnail.jpg?width=640&height=640&fit=bounds)
![20260201 [FOSDEM] gomodjail - library sandboxing for Go modules.pdf](https://cdn.slidesharecdn.com/ss_thumbnails/20260201fosdemgomodjail-librarysandboxingforgomodules-260201225659-76609ec4-thumbnail.jpg?width=640&height=640&fit=bounds)
TestCon2018 - Next Generation Testing in the Age of Machines
- 1. Berk Dülger, October2018 berk.dulger@keytorc.com linkedin.com/in/berkdulger Next Generation Testing in the Age of Machines
- 3.
- 4. THE CHANGE There isnothing permanent except change — Greek philosopher, Heraclitus (BC 535 - 475)
- 5. CHAOS THEORY Edward Lorenzand the Discovery of the Butterfly Effect In basics, Edward Lorenz theorized that weather prediction models are inaccurate because knowing the precise starting conditions is impossible, and a tiny change can throw off the results. In order to make the concept understandable to non-scientific audiences, Lorenz began to use the butterfly analogy.
- 6. AN EXAMPLE OFUNCERTAINTY: BITCOIN PRICES
- 7. WE ARE BADAT PREDICTIONS French artwork from 1899 that predicted society in the year 2000
- 8. BUT MIGHT FORECAST WATCHTHE MAN NOT THE DOG — Neil Degrasse Tyson, Astrophysicist
- 9.
- 10.
- 11. PAST NOW WHAT WEHAVE LEARNT... WHAT DO WE SPEAK ON...
- 12. NOWPAST TESTING AT THEEND TESTING THROUGHOUT TESTER RESPONSIBILITY TEAM RESPONSIBILITY RELYING on SPECIFICATIONS DEFINING ACCEPTANCE CRITERIA BUG DETECTION BUG PREVENTION TESTER SKILLS CODING/TECHNICAL SKILLS EXPLORINGCHECKING
- 13. WHAT ARE EXPECTEDFROM TESTER Source: ISTQB® WorldWide Software Testing practices Report 2017-18
- 14. 1 - PROACTIVErather than REACTIVE Source: State of Testing Survey 2016 Take the initiative of your life, job, anything you care.
- 15. 2 - TTT-SHAPErather than I-SHAPE Source: DevOps Institute
- 16. 3 - SHARERrather than COLLECTOR “While we teach, we learn,” said — Roman philosopher Seneca (AD, 1st Century) Source: QA Intelligence Survey
- 17. 4- LEADER ratherthan FOLLOWER
- 18. 5- THINKER ANDDOER rather than THINKER OR DOER
- 19. 6 - SYSTEMrather than COMPONENT THINKER
- 20. 7 - UXAWARE: USERS ARE SHARING!
- 21. 8- ADAPTATION TOCHANGE
- 22. OUR CASE STUDY- WHAT DID WE DO? ● Created team mail groups ● Empowered team members to contribute something different than their core responsibility i.e charity ● Conducted “Design Thinking Workshops” to facilitate ideation ● Organized “Talent 4.0 Workshops” focusing something completely different than testing ● Encouraged people to organize their own events
- 23. SURVEY 1: TESTPEOPLE goo.gl/JuS1Nr
- 24.
- 25. TEST ORGANIZATION TRENDS Source:QA Intelligence Report
- 26. 1 - FLATand OPEN ORGANIZATIONS
- 27. 2 - ONEOF THE PRINCIPLES OF STRATEGIC LEADERSHIP - SAFE TO FAIL Anyone who says, "Never change a working software" basically admits not having a safe-to-fail environment. Source: www.strategy-business.com/article/10-Principles-of-Strategic-Leadership
- 28. 3 - DON’TMEASURE PEOPLE! Measure the Process instead of People!!
- 29. 4 - PERFORMANCEvs STRESS Aubrey Daniels International (ADI), discretionary effort
- 30. 5 - FALLINTO THE ZONE Mental state in terms of challenge level and skill level, according to Csikszentmihalyi's flow model
- 31. 6 - CREATEYOUR OWN FREEDOM! Quality not always flow from top... Sustainable success requires bottom-up practices and top- down management support
- 32. OUR CASE STUDY- WHAT DID WE DO? ● Took a step toward to a flatter organization ● Made upper-management reachable ● Put some, but not much, challenge and stress on people ● Let people fail under control ● Put specific metrics away (i.e defect rejection rate, number of test cases etc. ) for performance evaluation to reduce unnecessary stress
- 33. SURVEY 2: TESTORGANIZATION goo.gl/hu3ePW
- 34.
- 35. TREND TOPICS -IN FIVE YEARS Source: ISTQB® WorldWide Software Testing practices Report 2017-18
- 36. 1 - ELEPHANTIN THE ROOM - DEVOPS NEAR FUTURE Source: https://blogs.technet.microsoft.com/uktechnet/2015/12/18/demystifying-devops-behaviours/
- 37. 1 - ELEPHANTIN THE ROOM - DEVOPS - ADOPTION Source: World Quality Report 18-19 NEAR FUTURE
- 38. DevOps is nota goal, but a process of continuous improvement
- 39. 1 - ELEPHANTIN THE ROOM - DEVOPS - THE CHASM NEAR FUTURE Source: https://sdtimes.com/ai/whats-beyond-continuous-testing-ai/
- 40. 1 - ELEPHANTIN THE ROOM - DEVOPS - CONTINUOUS TESTING Continuous Testing takes place in the hearth of the everlasting feedback cycle. It makes testing fast, robust and provide higher coverage than conventional methods by shifting it left for better product quality. Continuous Testing makes it able to manage end-to-end software lifecycle integrating with enterprise architectural components leading customer orientation. NEAR FUTURE
- 41. 1 - ELEPHANTIN THE ROOM - DEVOPS - SHIFTING LEFT ● Extemelly short feedback cycles ● Immediate regression analysis ● Increased product quality ● Lower technical debt ● Decreased business risk NEAR FUTURE
- 42. 2 - BEHAVIORDRIVEN DEVELOPMENT •Modelling the user behavior •Pre-designing the product back-end and writing testable software •Business stakeholder test automation involvement •Effective communication among stakeholders •End-to-end test readability and indirectly increased trust to software •Updated, living documentation NEAR FUTURE
- 43. 3 - INTERNETOF THINGS NEAR & MIDDLE FUTURE Source: World Quality Report 17-18
- 44. 4 - BIGDATA and STATISTICS NEAR & MIDDLE FUTURE ● Define what is Big Data. Any exadata is big? ● Use 5V Rule. Variety, Velocity, Volume, Verification, Value ● Learn Statistics 101 (Mean, median, 95th perc. etc.) ● Learn a useful scripting language for analytical analysis, like “R” ● From testing perspective, consider adopting DB agility to your Continuous X cycle, because without data there is no real “Continuous” thing
- 45. 5 - ARTIFICIALINTELLIGENCE MIDDLE & FAR FUTURE ● Becomes feasible with increasing computational power ● Many debates on moral side ● Different approaches, i.e in Machine Learning there are two major applications; unsupervised learning and supervised learning ● There are many algorithms; ID3, Neural Networks etc. ● Super diverse applications, Molecular Analysis to Self-Driving Cars ● From test perspective it promising in Visual Automation, Virtualization of Interfaces, Defect Taxonomy, Predictive Behavior Analysis and so on...
- 46. 5 - ARTIFICIALINTELLIGENCE - TESTING Focused on areas where AI is being used to identify software quality issues, apply test inputs, validate outputs, emulate users or other conditions. Source: https://www.aitesting.org MIDDLE & FAR FUTURE Self-testing in the context of AI includes both leveraging AI in self-testing systems, and incorporating self-testing into AI systems. This new area of research focused on how to enable systems to, well, test themselves. Testing AI is focused on methods for testing software where AI is a major component of functionality or purpose. Issues such as measuring quality, testing training processes, data cleaning, sourcing test data, measuring 'drift', among others.
- 47. OUR CASE STUDY- WHAT DID WE DO? ● Challenged ourselves! Participated competitions ● Created a corporate training portal ● Gave sponsorship for any paper acceptance ● Built a division for innovation ● Put %10 effort to research ● Started using DevOps, Continuous X and BDD practices even not charged to customer. ● Chosen an area of AI to study - Let’s Start Robotic Process Automation -
- 48. BLOG: ROBOTIC PROCESSAUTOMATION goo.gl/T9iEZ2
- 49. SURVEY 3: TESTTECHNOLOGY goo.gl/L2y2PB
- 50. A SNEAK PEEK TO THESURVEY Test People http://goo.gl/8SRKdn Test Organization http://goo.gl/tqjH8q Test Technology http://goo.gl/ymjMfn
- 51.
- 52. Berk Dülger, October2018 berk.dulger@keytorc.com linkedin.com/in/berkdulger THANKS FOR ATTENDING