CCCNA17 Distributed CI and Testing for Cloudstack in a Hybrid Community
0 likes189 views
Everybody runs on specialised hardware and software environments. A lot of us are also running our own version of the Apache CloudStack software itself. This results in 1000s of different permutated environments in which it runs and should keep running. Is it realistic to want full test coverage, let alone a CI pipeline across all of these? This talk will outline a vision for a distributed, community based test platform that allows any users of the system to contribute automated test results, based on their environments and their configurations during the development life cycle. Two recent initiatives will be highlighted: the Trillian framework and @blueorangutan which contribute to delivering this overall vision. It'll also be shown what there is left to do and the input required from the community to make this vision reality.
More Related Content
What's hot (20)
Similar to CCCNA17 Distributed CI and Testing for Cloudstack in a Hybrid Community (20)
More from ShapeBlue (20)
Recently uploaded (20)
CCCNA17 Distributed CI and Testing for Cloudstack in a Hybrid Community
- 1. The Cloud Specialists Distributed CI and testing for cloudstack in a hybrid community Daan Hoogland Not senior. Not manager. Other job titles apply. [email protected] +DaanHoogland
- 2. C l i c k t o e d i t The Cloud Specialists ShapeBlue.com @ShapeBlue • About • You • Me • My employer • Present – what is there at the moment • Goal – a compatibility matrix • Trillian (the shapeblue integration toolkit) C o n t e n t s
- 3. C l i c k t o e d i t The Cloud Specialists ShapeBlue.com @ShapeBlue A b o u t M e • • •
- 4. C l i c k t o e d i t The Cloud Specialists ShapeBlue.com @ShapeBlue A b o u t Yo u • New Cloudstack user • Infrastructure VAR or producer • Integrator • Interested in improvement of the platform • Interested in contributing Quality insurance infrastructure Well tested code
- 5. C l i c k t o e d i t The Cloud Specialists ShapeBlue.com @ShapeBlue “ShapeBlue are expert builders of public & private clouds. They are the leading global CloudStack services company.” A b o u t S h a p e B l u e
- 6. C l i c k t o e d i t The Cloud Specialists ShapeBlue.com @ShapeBlue S h a p e B l u e c u s t o m e r s
- 7. C l i c k t o e d i t The Cloud Specialists ShapeBlue.com @ShapeBlue S h a p e B l u e c u s t o m e r s
- 8. C l i c k t o e d i t The Cloud Specialists ShapeBlue.com @ShapeBlue S h a p e B l u e c u s t o m e r s
- 9. C l i c k t o e d i t The Cloud Specialists ShapeBlue.com @ShapeBlue W h a t ’ s i n i t • Endgame (goal) • Tools at the moment • Trillian and
- 10. C l i c k t o e d i t The Cloud Specialists ShapeBlue.com @ShapeBlue e n d g a m e • The goal of the community is to create a compatibility matrix of what works in CloudStack and in which environment, which will be easily maintainable and clear to users • We have a hybrid community in terms of used hard- and software infrastructure. Testing everything is a challenge. (British understatement)
- 11. C l i c k t o e d i t The Cloud Specialists ShapeBlue.com @ShapeBlue T h e c o m p a t i b i l i t y m a t r i x • The compatibility matrix • There must be a way to report • Compatible • Failing • Unstable • Untested (default) • It must be reported per • ACS version • Feature • Context (whut?)
- 12. C l i c k t o e d i t The Cloud Specialists ShapeBlue.com @ShapeBlue Test run for PR 42 Environment Hypervisor Networking Extras Results ShapeBlue 1 vmware advanced Community env 1 xen advanced Cloudops test xen advanced Interoute pre-production vmware advanced Shuberg Philis betacloud KVM advanced sdn/nicira BT test bed vmware basic PcXtreme KVM basic Anamyous coward’s environment KVM Advanced
- 13. C l i c k t o e d i t The Cloud Specialists ShapeBlue.com @ShapeBlue To o l s a t t h e m o m e n t • Devcloud4 • Bubble (kvm, yay) • Trillian (vmware, but ansible o/) more later • Github/Gitbox (needs long and extensive explanation that will require an entirely new series of ta • Bots (blueorangutan, cloudmonger) • Upr (https://github.com/cloudops/upr)
- 14. C l i c k t o e d i t The Cloud Specialists ShapeBlue.com @ShapeBlue w h y • Many, many, MANY permutations of a CloudStack deployment…. • Basic / Advanced • Local / shared / mixed storage • More than 8 common hypervisor types/versions • 4 or 5 Management server OS possiblilities • That’s 144 combinations only looking the basics. • Previous attempts at test automation haven’t been able to get coverage or capacity.
- 15. C l i c k t o e d i t The Cloud Specialists ShapeBlue.com @ShapeBlue Tr i l l i a n • Ability to support multiple concurrent environments • No hardcoding to a specific (our) lab/environment • As few separate components as possible • Separation of ‘code’ and ‘configuration’ • Scripted command-line use fully supported • Ability to support as many hypervisors as possible • As flexible as possible • Best ‘performance’ possible • Best utilization of hardware resources possible
- 16. C l i c k t o e d i t The Cloud Specialists ShapeBlue.com @ShapeBlue • Trillian • Ansible based environment builder • Multi-tenant (and multiple concurrent environments) • CloudStack builds the Virtual Infrastructure • Hypervisor hosts are CloudStack templates • Supports multiple and mixed hypervisors • Supports Advanced and Basic networks • Open source
- 17. C l i c k t o e d i t The Cloud Specialists ShapeBlue.com @ShapeBlue S h a p e b l u e ’ s b o t • Blue Orangutan • Build-bot • Automation endpoint to send build jobs to Jenkins for CentOS 6/7 and Debian packages from CloudStack source • Provides an integrated way to create packages from pull requests in Github. • Can kick-off Jenkins jobs to build and test environments based on packages which it builds.
- 18. C l i c k t o e d i t The Cloud Specialists ShapeBlue.com @ShapeBlue b l u e o r a n g u t a n • when trilian result finish we use this to build the reports: https://github.com/shapeblue/Trillian/blob/master/Ansible/roles/marvin/files/xunit-reader.py we build the reports here: https://github.com/shapeblue/Trillian/blob/master/Ansible/roles/marvin/templates/smoketests.sh.j2 • for posting comments, we use github apis keys etc. • that part's in the secret file some-scheme://some/path/to/blueorangutan/bo.py
- 19. C l i c k t o e d i t The Cloud Specialists ShapeBlue.com @ShapeBlue c o n c l u s i o n s • Add upr to bots • Several ways to our ideal • Trillian is there as tool, proper reporting is key • Next we want to orchestrate what test runs whereneed Or behaviour like it
- 20. C l i c k t o e d i t The Cloud Specialists ShapeBlue.com @ShapeBlue A v i s i o n • Winston • Test Orchestrator (Future project) • Receives ‘offers’ of test type/capacity from remote test labs • Takes request from Blue Orangutan to test packages and distributes tests to suitable remote labs. • Offers might include: • Use of local storage • Use of basic vs advanced networks • Use of particular hypervisors/versions
- 21. C l i c k t o e d i t The Cloud Specialists ShapeBlue.com @ShapeBlue A p a c h e C l o u d s t a c k n e e d s y o u
- 22. C l i c k t o e d i t The Cloud Specialists ShapeBlue.com @ShapeBlue Guru tell me …?