Download to read offline
Uploaded byAshish Parkhi
Techniques to speed up your build pipeline
The document outlines strategies to expedite continuous integration (CI) build pipelines, focusing on addressing bottlenecks related to disk I/O and CPU performance. Key principles include dividing tasks for parallel execution, prioritizing tests for faster feedback, and utilizing optimized storage solutions such as SSDs and in-memory databases. The overall goal is to reorganize the build process to minimize build times and improve efficiency.
More Related Content
![[jqconatx] Adaptive Images for Responsive Web Design](https://cdn.slidesharecdn.com/ss_thumbnails/adaptive-imagesv14-130911193737-phpapp01-thumbnail.jpg?width=640&height=640&fit=bounds)
![[In Control 2010] HTML5](https://cdn.slidesharecdn.com/ss_thumbnails/incontrolorlandohtml5-100302003930-phpapp01-thumbnail.jpg?width=640&height=640&fit=bounds)
![[D2]java 성능에 대한 오해와 편견](https://cdn.slidesharecdn.com/ss_thumbnails/d2java-150522063126-lva1-app6891-thumbnail.jpg?width=640&height=640&fit=bounds)
Similar to Techniques to speed up your build pipeline
Techniques to speed up your build pipeline
- 2. Techniques to Speed UpYour CI Build Pipeline [email protected] [email protected] @AshishParkhi @nashjain ashishparkhi.com nareshjain.com
- 3. About 10 to12 months back... About 60 to 90 minutes
- 4. Impact on life Imagesource – http://ak3.picdn.net/shutterstock/videos/5132438/preview/stock-footage-mixed-ethnicity-group-of-medical-professionals-working-late-at-night-are- looking-at-a-computer.jpg http://the247analyst.files.wordpress.com/2011/10/dealing-with-pressure.jpg http://www.dimitri.co.uk/business/business-images/worker-alone-dark-office.jpg http://cdn.sheknows.com/articles/2012/10/crying-little-girl.jpg
- 5. Build Pipeline –Under 10 Minutes
- 6. Focus on the Bottlenecks Divideand Conquer Key Principles to Speed Up Your Build Pipeline Fail Fast
- 7. Commercial Break [email protected] [email protected] @AshishParkhi@nashjain ashishparkhi.com nareshjain.com
- 8. Focus on the Bottlenecks Divideand Conquer Key Principles to Speed Up Your Build Pipeline Fail Fast
- 9. Disk IO –Example File Operations Focus on Bottleneck
- 10. Disk IO –Example Database operations. Image Source - https://encrypted-tbn3.gstatic.com/images?q=tbn:ANd9GcTPdVawndjUZbU2PDn-oKgjBPqmgDqr3PPZatZh9kxEgNi71AND http://www.dba-oracle.com/images/large_disk_hot_files.gif Focus on Bottleneck
- 11. Disk IO –Alternative Image Source - http://3.bp.blogspot.com/-bqTjSN7pSpg/UbqyjVojEFI/AAAAAAAADBw/PWe0kiuRHJ4/s200/no+duplicate+content.jpg • Avoid file operations – e.g. duplicating workspace Focus on Bottleneck
- 12. Disk IO –Alternative • Avoid file operations – e.g. Jar creation. Focus on Bottleneck Image Source - http://i1.wp.com/blog.quoteroller.com/wp-content/uploads/2013/04/Dont-start-from-scratch.png?resize=800%2C264
- 13. Disk IO –Alternative Image source - http://4.bp.blogspot.com/_4hvqisoH9CE/TSZIs7eiSAI/AAAAAAAAA7E/vanj6bGD8XQ/s1600/big-vs-small-left.jpg • Test on smaller but apt data set. Focus on Bottleneck
- 14. Disk IO –Alternative • Robocopy/rsync. Focus on Bottleneck Image Source - http://www.asustor.com/images/admv2/022_Rsync%20Backup-The-ultimate-tool-for-remote-backup.png
- 15. Disk IO –Alternative - SSD CrystalDiskMark - http://crystalmark.info/software/CrystalDiskMark/index-e.html • HDD (Toshiba MQ01ACF050 500GB SATA III) vs SSD (Samsung PM851 512GB mSata) Focus on Bottleneck
- 16. Disk IO –Alternative - SSD • HDD SSD Focus on Bottleneck
- 17. Disk IO –Alternative - In Memory DB Memory (Heap) Engine – had some limitations over myisam engine. Focus on Bottleneck
- 18. Disk IO –Alternative - In Memory DB – was not supporting many MySQL queries so was discarded. Focus on Bottleneck
- 19. Disk IO –Alternative - In Memory DB database – looked promising as it could support many MySQL queries but still required couple of modifications to our code. Focus on Bottleneck
- 20. Disk IO –Alternative - In Memory DB – looked most promising as it is wire compatible with MySQL, which means without code changes I could just point to memsql and be done with it. Focus on Bottleneck
- 21. Disk IO –Alternative - RAM Drive • SoftPerfect RAM Disk Focus on Bottleneck
- 22. Disk IO –Alternative – RAM Drive • RAM Drive Focus on Bottleneck
- 23. Disk IO –Alternative – RAM Drive • RAM Drive – did not work Focus on Bottleneck
- 24. Disk IO –Alternative – RAM Drive • RAM Drive – did not work Focus on Bottleneck
- 25. CPU - Profiling Focuson Bottleneck
- 26. CPU – Profiling- Insights Image source - https://encrypted-tbn1.gstatic.com/images?q=tbn:ANd9GcQde6NeSrbuv40CIhKtFa1OuIQXf7F7esMJKp1Ie7zmH2t29l6Z Scanning resource bundle files from jars. Focus on Bottleneck
- 27. CPU – Profiling- Insights Image source - http://2.bp.blogspot.com/-uKMyLlB3F7o/Tqn_6yqdElI/AAAAAAAAB94/_1FMbHJFQBQ/s1600/weight-lift-cartoon.jpg Loading Spring Application Context. Focus on Bottleneck
- 28. CPU – Profiling- Insights Image source - http://dilbert.com/dyn/str_strip/000000000/00000000/0000000/000000/00000/7000/000/7029/7029.strip.gif Avoiding unnecessary activities during build e.g. sending out email. Focus on Bottleneck
- 29. CPU – Profiling- Insights java.util.Calendar is horribly slow. Total processing time took 20.72 minutes out of which Date Arithmetic took 18.15 minutes which is about 87.6% of the total processing time! Focus on Bottleneck
- 30. CPU – Profiling- Insights java.util.Calendar is horribly slow. We switched to joda date library and deprecated java.util.Date API. Now Date Arithmetic takes 1.30 minutes; that’s a massive saving of 93.77% Focus on Bottleneck
- 31. CPU - ANT1.7 Junit task options. Focus on Bottleneck
- 32. Focus on the Bottlenecks Divideand Conquer Key Principles to Speed Up Your Build Pipeline Fail Fast
- 33. CPU - RunningTests Concurrently • Create parallel jobs. Divide and Conquer
- 34. CPU - RunningTests Concurrently • Distribute tasks across multiple slaves. Divide and Conquer Image source - https://wiki.jenkins-ci.org/download/attachments/2916393/logo.png?version=1&modificationDate=1302753947000
- 35. CPU - RunningTests Concurrently Image source - http://sharpreflections.com/wp-content/uploads/2012/06/multi_core_cpu.png • Using @RunWith(ConcurrentJunitRunner.class). – Courtesy - Mathieu Carbou http://java.dzone.com/articles/concurrent- junit-tests – Maven Surefire plugin has built in mechanism. Divide and Conquer
- 36. Focus on the Bottlenecks Divideand Conquer Key Principles to Speed Up Your Build Pipeline Fail Fast
- 37. Restructure The BuildPipeline Image Source - http://javapapers.com/wp-content/uploads/2012/11/failfast.jpg • We want our builds to give us fast feedback. Hence it is very important to prioritise your build tasks based on what is most likely to fail first. • Push unnecessary stuff to a separate build – Things like JavaDocs can be done nightly. • Separate out fast and slow running tests. Fail Fast
- 38. Prioritize Test • Weprioritize and group our tests so that the tests which are fast and mostly likely to fail are run first. – ProTest framework Fail Fast
- 39. Incremental Build vs.Clean Build • Local dev builds are incremental, instead of clean builds, as it helps with faster feedback and fail fast. Fail Fast
- 40.
- 41. Summary • Focus onbottlenecks & Shifts in bottlenecks – Avoid Disk IO - File operations, file based database operations. – Use smaller datasets, robocopy, rsync. – Use in-memory databases, Ram Drives, SSDs. – Perform CPU profiling, scan logs, to uncover the unknown. – Verify build tool settings. • Divide and Conquer – Create smaller jobs that can run in parallel. – Distribute jobs across multiple slaves. – Write tests that can run in isolation and use ConcurrentJunitRunner to run them in parallel. • Fail Fast – Restructure the build pipeline to uncover failures soon. – Incremental Builds – Prioritize tests.
- 42. Build Time VsNo Of Builds Removed Workspace Duplication Ant Junit Task – Fork Once Ram Disk Caching Resource Caching Spring Context Avoided Email Joda DateTime Deprecated Date API Concurrent Junit Runner
- 43. Impact on life Imagesource - http://t3.gstatic.com/images?q=tbn:ANd9GcTCvK8pY5qcp7Gl3ZBjxN1mc1HVHdiy1sQhByKeGgUk_5eJuUk7cA https://encrypted-tbn3.gstatic.com/images?q=tbn:ANd9GcQpoUXqhEpdGl1cLzn4gQsng_GyxUmOKWxYUH6GfrjN_FRUYPxw-Q
- 44. Resources • Jenkins –http://jenkins-ci.org/ • CI – http://en.wikipedia.org/wiki/Continuous_integration • Mklink – http://technet.microsoft.com/en-us/library/cc753194.aspx • http://ant.apache.org/manual/Tasks/junit.html • http://java.dzone.com/articles/javalangoutofmemory-permgen • SSD – http://en.wikipedia.org/wiki/Solid-state_drive • Hybrid disk – http://en.wikipedia.org/wiki/Hybrid_drive • HSQL – http://hsqldb.org/ • H2 – http://www.h2database.com/html/main.html • Memsql – http://www.memsql.com/ • MySQL is bazillion times faster than MemSQL • Tmpfs – http://en.wikipedia.org/wiki/Tmpfs • http://blog.laptopmag.com/faster-than-an-ssd-how-to-turn-extra-memory-into-a-ram-disk • RAM Disk Software Benchmarked • http://jvmmonitor.org/ • http://searchvmware.techtarget.com/tip/VMware-snapshot-size-and-other-causes-for-slow- snapshots • http://blogs.agilefaqs.com/2014/10/03/key-principles-for-reducing-continuous-integration-build- time/ • http://googletesting.blogspot.com/2011/06/testing-at-speed-and-scale-of-google.html • http://www.infoq.com/presentations/Development-at-Google • http://crystalmark.info/software/CrystalDiskMark/index-e.html
- 45. © Copyright IntegratedDecisions and Systems, Inc. (IDeaS – A SAS COMPANY) Visit IDeaS online at www.ideas.com Thank you. [email protected] [email protected] @AshishParkhi @nashjain ashishparkhi.com nareshjain.com
Editor's Notes
- #10 Two aspects discouraged me from going that path, firstly memsql can only be install on Linux, second I came across the blog MySQL is bazillion times faster than MemSQL I also came to know that Linux (any Unix flavor) already has this built-in with its tmpfs
- #11 Two aspects discouraged me from going that path, firstly memsql can only be install on Linux, second I came across the blog MySQL is bazillion times faster than MemSQL I also came to know that Linux (any Unix flavor) already has this built-in with its tmpfs
- #12 Two aspects discouraged me from going that path, firstly memsql can only be install on Linux, second I came across the blog MySQL is bazillion times faster than MemSQL I also came to know that Linux (any Unix flavor) already has this built-in with its tmpfs
- #13 Two aspects discouraged me from going that path, firstly memsql can only be install on Linux, second I came across the blog MySQL is bazillion times faster than MemSQL I also came to know that Linux (any Unix flavor) already has this built-in with its tmpfs
- #16 Two aspects discouraged me from going that path, firstly memsql can only be install on Linux, second I came across the blog MySQL is bazillion times faster than MemSQL
- #17 Two aspects discouraged me from going that path, firstly memsql can only be install on Linux, second I came across the blog MySQL is bazillion times faster than MemSQL
- #18 Two aspects discouraged me from going that path, firstly memsql can only be install on Linux, second I came across the blog MySQL is bazillion times faster than MemSQL
- #19 Two aspects discouraged me from going that path, firstly memsql can only be install on Linux, second I came across the blog MySQL is bazillion times faster than MemSQL
- #20 Two aspects discouraged me from going that path, firstly memsql can only be install on Linux, second I came across the blog MySQL is bazillion times faster than MemSQL I also came to know that Linux (any Unix flavor) already has this built-in with its tmpfs
- #24 Two aspects discouraged me from going that path, firstly memsql can only be install on Linux, second I came across the blog MySQL is bazillion times faster than MemSQL I also came to know that Linux (any Unix flavor) already has this built-in with its tmpfs
- #25 Two aspects discouraged me from going that path, firstly memsql can only be install on Linux, second I came across the blog MySQL is bazillion times faster than MemSQL I also came to know that Linux (any Unix flavor) already has this built-in with its tmpfs
- #26 Two aspects discouraged me from going that path, firstly memsql can only be install on Linux, second I came across the blog MySQL is bazillion times faster than MemSQL I also came to know that Linux (any Unix flavor) already has this built-in with its tmpfs
- #27 Two aspects discouraged me from going that path, firstly memsql can only be install on Linux, second I came across the blog MySQL is bazillion times faster than MemSQL I also came to know that Linux (any Unix flavor) already has this built-in with its tmpfs
- #28 Two aspects discouraged me from going that path, firstly memsql can only be install on Linux, second I came across the blog MySQL is bazillion times faster than MemSQL I also came to know that Linux (any Unix flavor) already has this built-in with its tmpfs
- #29 Two aspects discouraged me from going that path, firstly memsql can only be install on Linux, second I came across the blog MySQL is bazillion times faster than MemSQL I also came to know that Linux (any Unix flavor) already has this built-in with its tmpfs
- #31 Two aspects discouraged me from going that path, firstly memsql can only be install on Linux, second I came across the blog MySQL is bazillion times faster than MemSQL I also came to know that Linux (any Unix flavor) already has this built-in with its tmpfs
- #32 Two aspects discouraged me from going that path, firstly memsql can only be install on Linux, second I came across the blog MySQL is bazillion times faster than MemSQL I also came to know that Linux (any Unix flavor) already has this built-in with its tmpfs
- #33 Two aspects discouraged me from going that path, firstly memsql can only be install on Linux, second I came across the blog MySQL is bazillion times faster than MemSQL I also came to know that Linux (any Unix flavor) already has this built-in with its tmpfs
- #34 Two aspects discouraged me from going that path, firstly memsql can only be install on Linux, second I came across the blog MySQL is bazillion times faster than MemSQL I also came to know that Linux (any Unix flavor) already has this built-in with its tmpfs
- #35 Two aspects discouraged me from going that path, firstly memsql can only be install on Linux, second I came across the blog MySQL is bazillion times faster than MemSQL I also came to know that Linux (any Unix flavor) already has this built-in with its tmpfs
- #37 Two aspects discouraged me from going that path, firstly memsql can only be install on Linux, second I came across the blog MySQL is bazillion times faster than MemSQL I also came to know that Linux (any Unix flavor) already has this built-in with its tmpfs