Red Hat® Ceph Storage and Network Solutions for Software Defined Infrastructure
4 likes1,595 views
This document discusses Intel's vision for software defined infrastructure (SDI) and provides examples of how their technology enables SDI. The key points are: 1. Intel's SDI vision is to provide dynamic, policy-driven management of compute, storage, and networking resources through abstraction, orchestration, and standards-based solutions. 2. Red Hat Ceph Storage is presented as an open source, scalable storage solution optimized for SDI through the use of commodity servers and SSDs. 3. Intel is contributing to open standards and growing an ecosystem of partners through their Network Builders program to accelerate the SDI transformation.
![Software Defined Storage (SDS) Architecture
Node
Northbound API
Southbound API
SDS CONTROLLER
ORCHESTRATOR
SDS CONTROLLER
• Has visibility into and
control of ALL storage
resources
• Coordinates between
apps, orchestrator, and
storage systems
• Allocates storage
resources to meet SLAs
Node
DATA SERVICES
DATA SERVICES
• Part of the storage SW
that runs in data plane to
optimize storage
• For example: Data
Deduplication, Erasure
Code, Tiering
APPLICATIONS
STORAGE SYSTEM
[Performance]
STORAGE SYSTEM
[DAS]
STORAGE SYSTEM
[Capacity]
STORAGE SYSTEM
[SAN]
STORAGE SYSTEM
[NAS]
7](https://image.slidesharecdn.com/redhatsummitsdi-150620002627-lva1-app6892/85/Red-Hat-Ceph-Storage-and-Network-Solutions-for-Software-Defined-Infrastructure-7-320.jpg)
Red Hat® Ceph Storage and Network Solutions for Software Defined Infrastructure
- 2. Data Center needs are Changing 2 • From collecting to analyzing data • To virtualizing networks and storage • To delivering secure & compliant cloud like services
- 3. 3 Traditional Data Center Resources are Limited Resource Requests Internal Resources
- 4. Intel Software Defined Infrastructure (SDI) Vision Dynamic, policy-driven resource management 4 SERVICES DELIVERY App #1 App #2 App #3 App #4 Orchestration Software Partner Hardware & Software Solutions Software defined SERVERS Software Defined STORAGE Software Defined NETWORKING Infrastructure Attributes POWER PERFORMANCE LATENCYTHERMALS ULTILIZATION LOCATION DURABILITY SDI is not: • A single product or solution Abstraction of SW from HW, provides flexibility and scalability Provisioning of resources dynamically (pay-as-you-grow) Orchestration of diverse systems through application SLOs to enable seamless access SDI is a framework: providing efficient, flexible, scalable standards-based compute, networking, and storage resources
- 5. 5 Intel SDI Assets Software Defined Infrastructure NETWORKING AND FABRIC SOFTWARE ECOSYSTEM + SOLUTION REFERENCE ARCHITECTURES SERVER BOARDS & SYSTEMS Intel® Cache Acceleration Software SSDs Intel® QuickAssist Technology PROCESSOR PLATFORMS Intel® Storage Acceleration Library (ISA-L) & Storage DPDK
- 7. Software Defined Storage (SDS) Architecture Node Northbound API Southbound API SDS CONTROLLER ORCHESTRATOR SDS CONTROLLER • Has visibility into and control of ALL storage resources • Coordinates between apps, orchestrator, and storage systems • Allocates storage resources to meet SLAs Node DATA SERVICES DATA SERVICES • Part of the storage SW that runs in data plane to optimize storage • For example: Data Deduplication, Erasure Code, Tiering APPLICATIONS STORAGE SYSTEM [Performance] STORAGE SYSTEM [DAS] STORAGE SYSTEM [Capacity] STORAGE SYSTEM [SAN] STORAGE SYSTEM [NAS] 7
- 8. 8 • SDS will provide a convenient way to manage all storage in the datacenter • Framework is still in development • So, how to get started with SDS? – Focus on the storage system layer – Implement scale-out storage systems from OEMs and ISVs built on standard high-volume servers SDS Vision to Action Deploying storage systems on standard, high-volume servers today supports a seamless transition to SDI tomorrow
- 9. Advent of Solid-State Drives (SSDs) •CPU = 175x vs. HDD IO = 1.3x •IOs reach the spindles in a random fashion •Gets worse with higher # of apps or VMs per LUN •SSDs $30/GB -> <$1/GB (‘08-’15) •Lower TCO than HDD ($, Watts, Space) •$ / IOPS better for SSDs ($0.01 vs $0.80) •SSDs are reliable (2MHr MTBF) 9 * Performance and cost figures are estimates for informational purposes only and may vary SSDs are a cost effective, reliable means to remove the storage bottleneck
- 10. 10 Red Hat® Ceph Storage • Ceph is an open-source, massively scalable, software-defined storage system which provides object, block and file system storage in a single platform. It runs on commodity hardware—saving you costs, giving you flexibility—and because it’s in the Linux kernel, it’s easy to consume. • Object Store (RADOSGW) – A bucket based REST gateway compatible with S3 and swift • File System (Ceph FS) – A POSIX-compliant distributed file system • Block device service (RBD) – OpenStack native support – Cinder-backend – Glance-backend – Kernel client and QEMU/KVM driver Ceph Object Storage RADOS – Reliable, Autonomous, Distributed Object Store Self-healing, self-managing intelligent storage nodes Ceph Object Library (LIBRADOS) Allows applications to directly access Ceph Object Storage Application Ceph Object Gateway (RADOS Gateway) Restful gateway for object storage Application Ceph Block Device (RBD) Reliable and fully distributed block device Host/VM Ceph Distributed File System (CephFS) Posix- compliant distributed file system Client
- 11. 11 Ceph Design Considerations • Consistency of an SSD Caching Drive within Ceph is key to overall consistent performance • The developers (technical documentation), warn about using the most consistent drives possible. Drives that protect the data. • Relatively inexpensive SSDs are often hiding issues that you need to find. http://ceph.com/docs/master/start/hardware-recommendations/#data-storage
- 12. 12 Open Source Virtual Storage Manager for Ceph VSM is designed for a bundled ceph storage appliance, it creates a ceph cluster and does management plus monitoring. See https://github.com/01org/virtual-storage-manager Allows easier Ceph Creation and Management Creates Ceph cluster Manages Ceph Monitors Ceph
- 14. Wireless Infrastructure Wireless Base Station Media Processing Routers and Switches Network Security Network Appliances Intelligent Edge Intel Innovations in Networking ACCESS NETWORKS EDGE/CORE NETWORKS ENTERPRISE Intel® AccelerationIntel® Architecture Intel® Software + + Intel ® VT-X Intel® VT-d Intel Data Direct I/O 14 Data Plane Development Kit Hyperscan – Pattern Matching Intel Quick Assist 10/40/100 Gb Intel Ethernet Intel Ethernet Switch Silicon Data Plane Development Kit Moore’s Law: The number of transistors incorporated in a chip will approximately double every 24 months
- 15. Intel Delivers SOFTWARE-DEFINED INFRASTRUCTURE INVESTMENT IN BUILDING STRONG ECOSYSTEMS COMMITMENT TO OPEN STANDARDS AND PLATFORMS INDUSTRY-LEADING INNOVATION AND TECHNOLOGY LEADERSHIP ACCELERATING THE MARKET 15
- 16. Workload Consolidation to IA A Decade of Investment 16 1. Intel® Media Server Studio requires an Intel® Xeon® E3 or Intel® CoreTM processor (processor graphics) Intel® Processors 2013+ Networking Accelerators/Chip set Other Architectures Other Architectures DSP Intel® Processors Intel® Processor + Networking Chipset DSP NPU/ASIC Sensory Network Assets Data Plane Development Kit 2006-20122004-2005EarlyPre-90’s Intel® Media Center Development Kit Mindspeed, Axxia AssetsDSP DSP NPU/ASIC Other Architectures NPU/ASIC NPU/ASIC Intel® Processors + Carrier Grade Linux* Multi-core Processors / Integration Many Opportunities One Tool Suite One Instruction Set Architecture KEY: Networking Investment Intel Investment AcquisitionNon-Intel Security Pattern Scanning SW Base Station Processing Technology & Network Processors 4:1 Strategy = Single architecture that consolidates the workloads into scalable and simplified solution
- 17. Open Source/Standards Fuel Transformation: Intel is a Leading Contributor *Other brands and names are the property of their respective owners OpenStack Orchestration IETF Service Function Chaining Open Networking Foundation NFV & MEC Open Daylight Open Source Controller Data Plane Development Kit DPDK.org Linux Distribution Contributor Open Platform for NFV Investing in contributions to SDN/NFV initiatives Specifications -> Code -> Test -> Reference Platforms Open vSwitch 17
- 18. Intel® Open Network Platform (ONP) Server * Other names and brands may be claimed as the property of others. 18 Intel® Xeon® processor E5 v3 Intel® Communications Chipset 89xx Series Intel® Ethernet Controller XL710 Open Source Software Stack Based on ETSI-NFVI Reference Architecture Intel® QuickAssist Technology Drivers Intel® Ethernet Drivers:10 & 40 GbE Linux Fedora OS KVM Hypervisor DPDK Open vSwitch OpenStack Cloud OS OpenDaylight Controller OPNFV project Industry standard High Volume Server What is it? • Server Hardware & Software reference design integrating Intel HW optimizations with Open Source ingredients used in SDN/NFV Who is it targeted at? • Directly to NFVI+VIM vendors: OEMs, TEMs, SIs, ODMs • Indirectly to: ISVs, CommSP • Adjacent Markets: Enterprise, Cloud SP Where does my customer get it? • ONP Software is released on Intel’s 01.org on quarterly basis in the form of: Reference Architecture Document; Benchmark Test Report; Collateral ; Application Demo Setup* How does it relate to Linux Foundation Open Platform for NFV (OPNFV)? • ONP Server is available today and will stay as Intel’s program to contribute covered ingredients into OPNFV
- 19. Intel® Network Builders Program - Partners 19 Enabling broad market participation to increase innovation Other brands and names are the property of their respective owners To find out more visit us at: https://networkbuilders.intel.com/
- 20. Customer Success Stories: SDN/NFV Network Operators & Enterprises Embracing SDN/NFV Using General-Purpose Processing Technology in Their Networks 2020 JUST A FEW EXAMPLES 25+ PILOTS IN PROCESS WORLDWIDE Other brands and names are the property of their respective owners
- 21. Telecom & Cloud Enterprise PoC’s / Deployments Industry Consortia Intel ONP Reference Architecture Intel Network Builders *Other brands and names are the property of their respective owners Intel is Investing in SDN/NFV Transformation Advance Open Source and Standards Deliver Open Reference Designs Collaborate on Trials and Deployments Enable Open Ecosystem on IA 21 Accelerating Network Transformation Through Industry Collaboration
- 22. Openet ETSI NFV Use Case 22
- 23. The world of computing has gone through rapid changes in recent years
- 24. This has lead to great improvements in how software is created, deployed, managed and used but how does this relate to mobile networks?
- 25. Our networks have not adapted to the same degree as many other computing driven industries
- 26. Virtualization to the Rescue Reduced time-to- market Reduced TCO Service Agility Dynamic Scalability Rapid Service Deployment
- 27. Openet’s Virtualization Architecture • Openet have being deploying solutions in fully virtualised environments for a number of years • Openet Configuration and Deployment Manager (CDM) was developed to provide VNF orcehstration and management prior to NFV • CDM was deployed in the worlds first Telco-grade virtualised PCC orchestration solution (pre NFV) • Currently deployed in 5 operator deployments • Supporting two large scale tier one deployments 600 Virtual Machines in its first deployment 400 Virtual Machines in its second deployment • Reduced upgrade time from weeks to a couple of hours 27
- 28. ETSI NFV PoC #32 - Virtualized vEPC 28
- 29. • Fully integrated & orchestrated vEPC enabling the rapid creation and deployment of new services using common service templates (Using VNFD) • Multiple independent PCC service deployments within single compute infrastructure • Common Or-Vnfm REST based interface (in line with NFV MANO) enabling: – Multi-Vendor VNF Management and full lifecycle management (Instantiate, Upgrade, Modify, Terminate, Monitor, Check feasibility) • Automated analytics based scaling • Monitor revenue generated per service • VNF based traffic emulation • SR-IOV based hardware acceleration ETSI NFV PoC#32 29
- 30. Service Monetization 30 • The ability to rapidly deploy and scale new services will lead to new revenue opportunities and business models • It is essential that operators can easily monetise and monitor these new service innovations
- 31. • Incorporates Openet Streaming Analytics into a Network Function Virtualisation (NFV) architecture • Enables real-time monitoring of Virtualised Network Function (VNF) telemetry • Just in time delivery of network resources: Predict demand and mitigate underutilisation of resources through automated feedback into orchestration layer to predict when to scale out VNF Monitoring and Automated Scaling 31
- 32. Openet’s PCRF, OCS and DRA have been optimized for performance using SR-IOV and CPU Pinning Virtualized instances of Openet’s PCRF/OCS/DRA with these performance optimizations have been deployed in live networks for a number of years Reduce CPU overhead and latencies compared to using virtual bridges Provides performance values within 10% of bare metal performance SR-IOV and CPU Pinning With the latest release of OpenStack now providing SR-IOV and CPU Pinning support, Openet’s VNFs can now utilize these in an OpenStack enabled NFV environment 32
- 33. 33 Summary Open standards accelerating SDI Intel® Network Builders is enabling a broad ecosystem on open source/standards Data center infrastructure evolving to keep pace Intel & Red Hat optimizing Ceph for Software Defined Infrastructure Learn more at the Intel booth #905