CloudOpen Japan - Controlling the cost of your first cloud
Download as PPTX, PDF0 likes747 views
The document discusses the essentials of establishing a cost-effective cloud infrastructure, emphasizing agility, lower operational expenses, and scalability. It highlights the need for strategic planning, including understanding service offerings, compliance, and operational costs, to ensure the cloud effectively supports business initiatives. Key comparisons are made between traditional enterprise data centers and modern cloud architectures to optimize performance and manage resources efficiently.
![Enterprise datacenter Cloud
• Architected for 100s of hosts
• Scale-up (server clusters)
• Applications assume reliability
• IT Management-centric
• Proprietary vendor stack
• Architected for 1000s of hosts
• Scale-out (multi-site server farms)
• Applications assume failure
• Autonomic [1:1,000’s]
• Open, value-added stack
Competing paradigms](https://image.slidesharecdn.com/cloudopen-japan-controllingthecostofyourfirstcloud-150604055845-lva1-app6891/85/CloudOpen-Japan-Controlling-the-cost-of-your-first-cloud-7-320.jpg)
CloudOpen Japan - Controlling the cost of your first cloud
- 1. CloudOpen Japan 2015 Controlling the cost of your first cloud
- 2. #whoami Name: Tim Mackey Current roles: XenServer Community Manager and Evangelist; occasional coder Cool things I’ve done • Designed laser communication systems • Early designer of retail self-checkout machines • Embedded special relativity algorithms into industrial control system Find me • Twitter: @XenServerArmy • SlideShare: slideshare.net/TimMackey • LinkedIn: www.linkedin.com/in/mackeytim
- 3. Clouds are cool Agility • Ease of provisioning w/o hardware latency • Remove IT as a service delivery critical path • Manage complete infrastructure, regardless of scale Lower operational expenses • Consistent application and service deployment • Drive reduced capital requirements • Visibility into user and line of business usage
- 4. Why we want a cloud – the reality Agility • Ease of provisioning w/o hardware latency • Remove IT as a service delivery critical path • Manage complete infrastructure, regardless of scale Lower operational expenses • Consistent application and service deployment • Drive reduced capital requirements • Visibility into user and line of business usage Our boss bought the hype!!!
- 5. Why we want a cloud – the reality Agility • Ease of provisioning w/o hardware latency • Remove IT as a service delivery critical path • Manage complete infrastructure, regardless of scale Lower operational expenses • Consistent application and service deployment • Drive reduced capital requirements • Visibility into user and line of business usage Our boss bought the hype … … but doesn’t want to look like an idiot
- 6. Today’s realities versus tomorrow’s norms IT is a large capital expense Work only happens in the office IT does support and maintenance Calling the helpdesk IT is a monthly operating expense Work happens wherever you are IT drives strategic initiatives On-demand, self-service IT IT Today IT Tomorrow
- 7. Enterprise datacenter Cloud • Architected for 100s of hosts • Scale-up (server clusters) • Applications assume reliability • IT Management-centric • Proprietary vendor stack • Architected for 1000s of hosts • Scale-out (multi-site server farms) • Applications assume failure • Autonomic [1:1,000’s] • Open, value-added stack Competing paradigms
- 8. Service offerings Clearly define what you want to offer • What types of applications • Who has access, and who owns them • What type of access Define how templates need to be managed • Operating system support • Patching requirements Define expectations around compliance and availability • Who owns backup and monitoring
- 9. Define tenancy requirements Department data local to department • Where is the application data stored Data and service isolation • VM migration and host HA • Network services Encryption of PII/PCI • Where do keys live when data location unknown • Need encryption designed for the cloud Showback to stakeholders • More than just usage, compliance and audits
- 10. Let’s build a cloud ….
- 11. Where to start … Deliver something easy • Web services are a perfect start • With experience grow the install base Pay for what you need • Use free hypervisors • Use free orchestration services Succeed early • Remember your success is tied to a happy boss
- 12. Enterprise system assumptions Redundant networking • LACP or bonding • Stacked switches • Additional NICs High performance storage • iSCSI/ Fiber Channel • Multiple paths High density systems management • Blade servers • Data center wide operations management
- 13. Let’s get some shiny new gear …. … because you can’t just reuse what you’ve got Redundant, independent networks • Management, storage, VM traffic 6 NICs High performance storage • 10 Gbps links for storage and VM traffic • 1 Gbps for management traffic Compute simplification • Blade based servers • Network fabric for network management VM specification • 2 vCPU, 8GB RAM, 40GB disk
- 14. The BOM – May 2015 Total hardware cost: 304 819 USD Capacity 240 VMs with minimal overcommit Component Cost HP BladeSystem Enclosure w/Flex 10 Interconnects 68 893 USD Compute blades (16x BL460c, dual socket, 128GB) 169 088 USD Cisco Nexus switches (2x 5548UP) 36 620 USD HP MSA Storage (24 drives/RAID 5/900GB) 30 218 USD
- 15. 1270 USD per VM 3086 USD for equivalent physical server
- 16. Did you build a cloud? Answering to the Boss Cost • Did we just refresh some hardware? • Have we improved anything? • Is this just “business as usual”? Capabilities • Are we more agile? • Can we take advantage of new paradigms? • Is this easier to manage?
- 17. Scalability and failure Fact • Cloud providers have outages • Networks go down • Usage varies Assertion • Is failure a form of scalability? • Can we leverage this in our design? • Is our paradigm correct?
- 18. Attack the storage paradigm
- 19. Shared storage growth and provisioning time 1,000 500 VMs Cost, AU100 200 500 VMs Provisioning efficiency AU – arbitrary units
- 20. Combined efficiency and storage evolution Redesign 1,000 500 VMs 100 200 Cost, AU VMs 1,000 500 Cost, AU100 200 ? Alternatives AU – arbitrary units
- 21. Redesign Efficiency and pod storage 1,000 500 VMs 100 200 Cost, AU POD #1 POD #2 POD #3 1,000 500 VMs 100 200 Cost, AU AU – arbitrary units No redesign
- 22. What about local storage? 1,000 500 VMs Cost, AU100 200 50 VMs Provisioning efficiency AU – arbitrary units
- 23. POD trend Traditional trend Cost-performance trends Shared Storage Local Storage 1,000 500 VMs Cost, AU100 200 1,000 500 VMs 100 200 Cost, AU Local storage Performance trend Local storage trend
- 24. Understanding relationship between VM density and IO
- 25. Plan B
- 26. The power of local storage Our IO requirements • 300-400 IOPs per blade • 3-4 SAS 10K disks, or SSD MLC Our storage requirements • 700-900 GB per blade Options • Storage blade (per pod) • Local storage per blade • Change to pizza boxes
- 27. Let’s get some shiny new gear …. … because you can’t just reuse what you’ve got Redundant, independent networks • Management, VM traffic 4 NICs No shared storage • 10 Gbps links for VM traffic • 1 Gbps for management traffic Compute • Rack based servers VM specification • 2 vCPU, 8GB RAM, 40GB disk
- 28. The BOM – May 2015 Total hardware cost: 166 652 USD Component Cost 16x Dell R630 (dual socket, 128GB, 4x300GB SAS 10k) 130 032 USD Cisco Nexus switches (2x 5548UP) 36 620 USD
- 29. 694 USD per VM 45% savings over “enterprise best practices” 77% savings over physical server
- 31. Understanding what you want to accomplish Public clouds are people carriers and minibuses YOUR cloud should be a race car • Optimize it for your needs Don’t rent what you can own cheaper • Cloud operator doesn’t care about your success • Optimized applications might be key Ensure you have backup plans • Usage can and does spike • Outages can and do happen vs.
- 32. Virtualization infrastructure choices Hypervisor defined by service offerings • Don’t select hypervisor based on “standards” • Understand true costs of virtualization • Multiple hypervisors are “OK” • Bare metal can be a hypervisor To “Pool” resources or not • Is there a real requirement for pooled resources • Can the cloud management solution do better? • Real cost of shared storage
- 33. Understanding the operational costs of clouds Instance provisioning • Time from request to network configuration • Time from request to VM start • Time from VM start to application running Application management • Unified template to reduce compliance variance • Configuration management for consistency • Auto-scaling for cost control Build Showback model • Create spot opportunity cost for instances
- 34. Power utilization as ROI motivator Server Configuration Power Requirements Heat Generation Cost of Power Operating Cost (Annual) Legacy DL360G6 18 790 W 64 072 BTU 0.17 USD/ kWh 56 000 USD BL460 Blades 5 290 W 18 072 BTU 0.17 USD/ kWh 15 766 USD Dell R630 5 710 W 19 420 BTU 0.17 USD/ kWh 17 018 USD Hardware refresh ROI approximates 40 000 USD savings per year 7.57 Years for power savings using blades with shared storage 4.27 Years for power savings with rack servers
- 35. The ROI of a private cloud Becoming a business partner to your organization EC2 costs (US/East) • m3.large (Linux) on-demand: 1352 USD per year • m3.large (Linux) 3 yr reserved: 1609 USD for three years • m3.large (RHEL) 3 yr reserved: 3348 USD for three years Your cloud infrastructure costs • 166 652 USD depreciated over 3 years: 231 USD per VM per year • 17 018 USD power/cooling per year: 70 USD per VM per year Become a service provider to your business • Provide on demand services, which scale with the business • Through business understanding, retain operational control of IT, simplify compliance monitoring • Demonstrate opportunity costs for cloud services
- 36. Tying it all together 1. Define success criteria 2. Evaluate current best practices 3. Define supported configurations 4. Decide on scaling model 5. Build costing model 6. Build your cloud 7. Scale to new workloads
- 38. Questions?
- 40. WORK BETTER. LIVE BETTER.
Editor's Notes
- #3: Twitter: @XenServerArmy SlideShare: slideshare.net/TimMackey LinkedIn: www.linkedin.com/in/mackeytim
- #7: Introduction: Today’s reality of “IT equals cost” is rapidly changing, so that the norm tomorrow will be “IT equals service and flexibility.” Key Points: The cloud enables IT spending to shift from big capital expenses (CAPEX) to a predictable monthly operating expense (OPEX). Paying for IT on a monthly basis is much more digestible than writing big checks for new servers and expensive software licenses. Mobile workstyles are now the norm, and “working” no longer means you have to be in the office to “work”. Work happens whenever and wherever you are, and business need solutions to enable this Cloud is an IT enabler that gets the IT team out of fire drill mode doing break/fix projects. Instead, they can innovate with new IT solutions that help drive the business and add strategic value in more of a CTO role. Instead of being dependent on IT and the helpdesk for everything, cloud enables on-demand, self-service IT so you can more easily and quickly get what you need done. Cloud hosted apps and desktops enable you to transform consumer devices into powerful work devices, with full access to everything you need to work,
- #15: HP BladeSystem priced on May 26th, 2015 from hp.com HP compute blades BL460c Gen9 priced on May 26th, 2015 from hp.com Cisco Nexus 5548UP priced from CDW on May 26th, 2015 HP MSA storage priced on May 26th, 2015 from pcconnection.com
- #16: Equivalent physical server is DL160 Gen8 with single socket processor, 8GB RAM and 500GB SATA disk
- #29: Dell R630 priced at 8127 USD on May 26th, 2015 from dell.com Nexus priced from CDW on may 26th, 2015
- #30: Equivalent physical server is DL160 Gen8 with single socket processor, 8GB RAM and 500GB SATA disk
- #35: Power estimates based on US MA power for mid-sized commercial electric customers in March 2015
- #36: EC2 pricing as of October 2nd, 2014
- #37: Image: Crossroads: Success or Failure Please give attribution to 'StockMonkeys.com' (and point the link towww.stockmonkeys.com). Thanks!
- #38: Images used in this deck are from http://upload.wikimedia.org/wikipedia/commons/d/d7/Kenya_countryside.jpg http://upload.wikimedia.org/wikipedia/commons/b/b6/Jello_Biafra_at_Fusion_Festival_2010.jpg https://www.flickr.com/photos/kevinkrejci/89177654/ https://www.flickr.com/photos/xmodulo/13595193213 https://www.flickr.com/photos/mikedefiant/394756564/ http://upload.wikimedia.org/wikipedia/commons/8/8b/CERN_Server.jpg http://upload.wikimedia.org/wikipedia/commons/0/0e/Anger_Controlls_Him.jpg https://www.flickr.com/photos/ktpupp/508647245 http://upload.wikimedia.org/wikipedia/commons/0/08/US_Navy_040814-N-5781F-033_Storekeeper_2nd_Class_Daniel_Mina_of_Detroit%2C_Mich.%2C_delivers_pizzas_to_eagerly_awaiting_Sailors_aboard_the_aircraft_carrier_USS_Kitty_Hawk_%28CV_63%29.jpg http://upload.wikimedia.org/wikipedia/commons/b/b6/Jello_Biafra_at_Fusion_Festival_2010.jpg http://upload.wikimedia.org/wikipedia/commons/b/b6/Golf_apparel.jpg