Clloud computing provisioing and benifits altanai bisht 2nd year , part ii

Clloud computing provisioing and benifits altanai bisht 2nd year , part ii

• 1.
  Cloud Computing ALTANAI BISHT. VELTECH MULTITECH DR Rangarajan DR Sakunthala ENGINEERING COLLEGE Dept of INFORMATION TECHNOLOGY , BTECH 1st YR ABSTRACT Innovation is necessary to ride the inevitable tide of change. Indeed, the success of the transformation of an organization to an On Demand Business depends on driving the right balance of productivity, collaboration, and innovation to achieve sustained, organic top line growth — and bottom line profitability. Enterprises strive to reduce computing costs. Many start by consolidating their IT operations and later introducing virtualization technologies. Cloud computing takes these steps to a new level and allows an organization to further reduce costs through improved utilization, reduced administration and infrastructure costs, and faster deployment cycles. Cloud computing describes both a platform and a type of application. A cloud computing platform dynamically provisions, configures, reconfigures, and deprovisions servers as needed.Cloud applications are applications that are extended to be accessible through the Internet. These cloud applications use large data centers and powerful servers that host Web applications andWeb services. Cloud computing infrastructure accelerates and fosters the adoption of innovations.Enterprises are increasingly making innovation their highest priority. They realize they need to seek new ideas and unlock new sources of value. Driven by the pressure to cut costs and grow— simultaneously—they realize that it’s not possible to succeed simply by doing the same things better. They know they have to do new things that produce better results. Cloud computing enables innovation. It alleviates the need of innovators to find resources to develop, test, and make their innovations available to the user community. Innovators are free to focus on the innovation rather than the logistics of finding and managing resources that enable the innovation. Cloud computing helps
• 2.
  leverage innovation asearly as possible to deliver business value to IBM and its customers. Fostering innovation requires unprecedented flexibility and responsiveness. The enterprise should provide an ecosystem where innovators are not hindered by excessive processes, rules, and resource constraints. In this context, a cloud computing service is a necessity. It comprises an automated framework that can deliver standardized services quickly and cheaply.Cloud computing infrastructure allows enterprises to achieve more efficient use of their IT hardware and software investments. Cloud computing increases profitability by improving resource utilization. Pooling resources into large clouds drives down costs and increases utilization by delivering resources only for as long as those resources are needed. Cloud computing allows individuals, teams, and organizations to streamline procurement processes and eliminate the need to duplicate certain computer administrative skills related to setup, configuration, and support. This paper introduces the value of implementing cloud computing. The paper defines clouds,explains the business benefits of cloud computing, and outlines cloud architecture and its major components. Readers will discover how a business can use cloud computing to foster innovation and reduce IT costs. CONTENTS What is a cloud?  Definition  Benefits  Usage scenarios  Architecture Cloud provisioning and management  Automated provisioning  Reservation & Scheduling  Open source  Virtualization  Storage architecture in the cloud  Piloting innovations on a cloud References Conclusion
• 3.
  What is acloud? Cloud computing is a term used to describe both a platform and type of application. A cloud computing platform dynamically provisions, configures, reconfigures, and deprovisions servers as needed. Servers in the cloud can be physical machines or virtual machines. Advanced clouds typically include other computing resources such as storage area networks (SANs), network equipment, firewall and other security devices.Cloud computing also describes applications that are extended to be accessible through the Internet. These cloud applications use large data centers and powerful servers that host Web applications and Web services. Anyone with a suitable Internet connection and a standard browser can access a cloud application.  Definition A cloud is a pool of virtualized computer resources. A cloud can: • Host a variety of different workloads, including batch-style back-end jobs and interactive, user- facing applications • Allow workloads to be deployed and scaled-out quickly through the rapid provisioning of virtual machines or physical machines • Support redundant, self-recovering, highly scalable programming models that allow workloads to recover from many unavoidable hardware/software failures • Monitor resource use in real time to enable rebalancing of allocations when needed. Cloud computing environments support grid computing by quickly providing physical and virtual servers on which the grid applications can run. Cloud computing should not be confused with grid computing. Grid computing involves dividing a large task into many smaller tasks that run in parallel on separate servers. Grids require many computers, typically in the thousands, and commonly use servers, desktops, and laptops. Clouds also support nongrid environments, such as a three-tier Web architecture running standard or Web 2.0 applications. A cloud is more than a collection of computer resources because a cloud provides a mechanism to manage those resources. Management includes provisioning, change requests, reimaging, workload rebalancing, deprovisioning, and monitoring.  Benefits Cloud computing infrastructures can allow enterprises to achieve more efficient use of their IT hardware and software investments. They do this by breaking down the physical barriers inherent in isolated systems, and automating the management of the group of systems as a single entity.
• 4.
  Cloud computing isan example of an ultimately virtualized system, and a natural evolution for data centers that employ automated systems management, workload balancing, and virtualization technologies. A cloud infrastructure can be a cost efficient model for delivering information services, reducing IT management complexity, promoting innovation, and increasing responsiveness through realtime workload balancing. The Cloud makes it possible to launch Web 2.0 applications quickly and to scale up applications as much as needed when needed. The platform supports traditional Java™ and Linux, Apache, MySQL, PHP (LAMP) stack-based applications as well as new architectures such as MapReduce and the Google File System, which provide a means to scale applications across thousands of servers instantly. Large amounts of computer resource, in the form of Xen virtual machines, can be provisioned and made available for new applications within minutes instead of days or weeks. Developers can gain access to these resources through a portal and put them to use immediately. Several products are available that provide virtual machine capabilities, including proprietary ones such as VMware, and open source alternatives, such as XEN. This paper describes the use of XEN virtualization.Many customers are interested in cloud infrastructures to serve as platforms for innovation,particularly in countries that want to foster the development of a highly skilled, high-tech work force. They want to provide startups and research organizations with an environment for idea exchange, and the ability to rapidly develop and deploy new product prototypes. In fact, HiPODS has been hosting IBM’s innovation portal on a virtualized cloud infrastructure in our Silicon Valley Lab for nearly two years. We have over seventy active innovations at a time, with each innovation lasting on average six months. 50% of those innovations are Web 2.0 projects (search, collaboration, and social networking) and 27% turn into products or solutions. Our success with the innovation portal is documented in the August 20 Business Week cover story on global collaboration.  Usage scenarios Cloud computing can play a significant role in a variety of areas including internal pilots, innovations, virtual worlds, e-business, social networks, and search. Here we summarize several basic but important usage scenarios that highlight the breadth and depth of impact that cloud computing can have on an enterprise.  e-business In e-business, scalability can be achieved by making new servers available as needed. For example,
• 5.
  during a peakshopping season, more virtual servers can be made available that can cater to high shopper demand. In another example a company may experience high workloads on weekends or evenings as opposed to early mornings and weekdays. If a company has a significantly large cloud, they could schedule computer resources to be provisioned each evening, weekend, or during a peak season. There are more opportunities to achieve efficiencies as the cloud grows. Another aspect of this scenario involves employing business policies to decide what applications receive higher priorities and thus more computing resources. Revenue generating applications may be rated higher than research and development or innovation pilots. For several months IBM has been running a cloud infrastructure that adjusts computer resources appropriately and automatically according to business policies.  Personal hobbies Innovation is no longer a concept developed and owned by companies and businesses. It is becoming popular at the individual level, and more individuals are coming up with innovations.These individuals could be requesting servers from a cloud to work on their innovations.  Architecture Figure 1 illustrates the high level architecture of the cloud computing platform. It’s comprised of a data center, IBM® Tivoli® Provisioning Manager, IBM® Tivoli®Monitoring, IBM® Websphere® Application Server, IBM® DB2®, and virtualization components. This architecture diagram focuses on the core back end of the cloud computing platform; it does not address the user interface. The success of cloud computing is largely based on the effective implementation of its architecture. In cloud computing, architecture is not just based on how the application will work with the intended users. Cloud computing requires an intricate interaction with the hardware which is very essential to ensure uptime of the application.
• 6.
  These two components(hardware and application) have to work together seamlessly or else cloud computing will not be possible. If the application fails, the hardware will not be able to push the data and implement certain processes.On the other hand, hardware failure will mean stoppage of operations. For that reason, precaution has to be done so that these components will be working as expected and necessary fixes has to be implemented immediately for prevention as well as quick resolution.  Data Centers One of the most distinguishing characteristics of cloud computing architecture is its close dependency on the hardware components. An online application is just a simple application that could be launched in different servers but when the application is considered with cloud computing, it will require massive data centers that will ensure the processes are done as expected and timely. Data centers for cloud computing architecture are not your run-of-the- mill data processing centers. It’s composed of different servers with optimal storage capacity and processing speed. They work together to ensure that the application will be operating as expected. The area is usually in a highly controlled environment where it would be constantly monitored through various applications and manually checked for actual physical problems. Cloud provisioning and management  Automated provisioning The core functionality of a cloud is its ability to automatically provision servers for innovators and to enable innovators, administrators, and others to use that function with a Web-based interface. The role-based interface abstracts out the complexity of IBM Tivoli Provisioning Manager, Remote Deployment Manager, Network Installation Manager, business process execution language (BPEL), and Web services. Typically, a pilot team needs four to twelve weeks to identify, procure, and build a pilot infrastructure and additional time to build a security compliant software stack so that developers can begin building or deploying applications and code. The cloud provides a framework and offering that reduces that boarding process to aproximately one hour. We accomplish this through a role- based Web portal that allows innovators to fill out a form defining their hardware platform, CPU, memory, storage, operating system, middleware, and team members and associated roles. This process takes about five minutes. After submitting the request through the portal, a cloud administrator is notified and
• 7.
  logs in toapprove, modify, and/or reject the request. If approved, the system begins a process involving Web services, Tivoli Provisioning Manager, and optionaly IBM Tivoli Security Compliance Manager, BPEL, IBM® Enterprise Workload Manager, and Remote Deployment Manger/Cluster Systems Managerment/Network Installation Manager to build the server(s). This process is fully automatic and completes in about an hour. The value of having a fully auomated provisioning process that is security compliant and automatically customized to innovators’ needs is manifested in reduced time to introduce technologies and innovations, cost savings in labor for designing, procuring, and building hardware and software platforms, and cost avoidance in higher use and reuse of existing resources.  Reservation and scheduling Critical to an environment like a cloud is the ability to understand what your current and future capacity is to accommodate customers. Without that understanding you cannot accurately forecast how many customers you can support, nor can you ensure that you maintain a steady pipeline of innovation. For this reason, projects cannot board the cloud without an agreed upon end date. This date which is part of the contract (an approved request for resources) offers an incentive for the project team to work aggressively to meet their target or risk the removal of the resource assigned. Contractual end dates also allow cloud administrators to accurately schedule resources for future dates. For this purpose the cloud also requires a contractual start date so that it is possible to reserve resources for a future time. Contract start dates give innovators an accurate expectation of when they will receive there approved resources. The reservation system in the cloud provides a system of checks and balances so that new reservations cannot be approved for resources that don’t exist or that are already committed for the specified time frame.  Open source Open source solutions played an important role in the development of the cloud. In particular, acouple of projects have been foundations for common cloud services such as virtualization and parallel processing. Xen is an open-source virtual machine implementation that allows physical machines to host multiple copies of operating systems. Xen is used in the cloud to represent machines as virtual images that can be easily and repeatedly provisioned and deprovisioned. Hadoop, now under the Apache license, is an open-source framework for running large data processing applications on a cluster. It allows the
• 8.
  creation and executionof applications using Google’s MapReduce programming paradigm, which divides the application into small fragments of work that can be executed on any node in the cluster. It also transparently supports reliability and data migration through the use of a distributed file system. Using Hadoop, the cloud can execute parallel applications on a massive data set in a reasonable amount of time, enabling computationally-intensive services such as retrieving information efficiently, customizing user sessions based on past history, or generating results based on Monte Carlo (probabilistic) algorithms.  Virtualization Virtualization in a cloud can be implemented on two levels. The first is at the hardware layer.Using hardware like the IBM System p™ enables innovators to request virtualized, dynamic LPARs with IBM ®AIX® or Linux operating systems. The LPAR’s CPU resource is ideally managed by IBM® Enterprise Workload Manager. Enterprise Workload Manager monitors CPU demand and use and employs business policies to determine how much CPU resource is assigned to each LPAR. The System p has micropartitioning capability, which allows the system to assign partial CPUs to LPARs. A partial CPU can be as granular as 1/10 of a physical CPU. Micropartitioning combined with the dynamic load balancing capabilities of Enterprise Workload Manager make a powerful virtualized infrastructure available for innovators. In this environment pilots and prototypes are generally lightly used at the beginning of the life cycle. During the startup stage, CPU use is generally lower because there is typically more development work and fewer early adopters or pilot users. At the same time, other more mature pilots and prototypes may have hundreds or thousands of early adopters who are accessing the servers. Accordingly, those servers can take heavy loads at certain times of the day, or days of the week, and this is when Enterprise Workload Manager dynamically allocates CPU resources to the LPARs that need them.The second implementation of virtualization occurs at the software layer. Here technologies such as Xen can provide tremendous advantages to a cloud environment. Our current implementations of the cloud support Xen specifically but the framework also allows for other software virtualization technologies such as VMWare’s ESX product. Software virtualization entails installing a hypervisor on an IBM System x or IBM System physical server. The hypervisor supports multiple “guest” operating systems and provides a layer of virtualization so that each guest operating system
• 9.
  resides on thesame physical hardware without knowledge of the other guest operating systems. Each guest operating system is physically protected from the other operating systems and will not be affected by instability or configuration issues of the other operating systems.  Storage architecture in the cloud The storage architecture of the cloud includes the capabilities of the Google file system along with the benefits of a storage area network (SAN). Either technique can be used by itself, or both can be used together as needed.Computing without data is as rare as data without computing. The combination of data and computer power is important. Computer power often is measured in the cycle speed of a processor. Computer speed also needs to account for the number of processors. The number of processors within an SMP and the number within a cluster may both be important.When looking at disk storage, the amount of space is often the primary measure. The number of gigabytes or terrabytes of data needed is important. But access rates are often more important.Being able to only read sixty megabyes per second may limit your processing capabilites below your computer capabilites. Individual disks have limits on the rate at which they can process data. A single computer may have multiple disks, or with SAN file system be able to access data over the network. So data placement can be an important factor in achieving high data access rates. Spreading the data over multiple computer nodes may be desired, or having all the data reside on a single node may be required for optimal performance. The Google file structure can be used in the cloud environment. When used, it uses the disks inside the machines, along with the network to provide a shared file system that is redundant. This can increase the total data processing speed when the data and processing power is spread out efficiently. The Google file system is a part of a storage architecture but it is not considered to be a SAN architecture. A SAN architecture relies on an adapter other than an Ethernet in the computer nodes, and has a network similar to an Etherent network that can then host various SAN devices. Typically a single machine has both computer power and disks. The ratio of disk capability to computer capability is fairly static. With the Google file system, the single node’s computer power can be used against very large data by accessing the data through the network and staging it on the local disk. Alternativly, if the problem lends itself to distribution, then many computer nodes can be used allowing their disks to also be involved.
• 10.
  With the SANwe can fundamentally alter the ratio between computer power and disk capability.A single SAN client can be connected to, and access at high speeds, an enormous amount of data.When more computer power is needed, more machines can be added. When more I/O capability is needed, more SAN devices can be added. Either capability is independent of the other. Fast write is a capability available on many SAN devices. Normal disk writes do not complete until the data has been written to disk, which involves spinning the disk, and potentially moving the heads. With fast write, the write completes when the data reaches memory in the SAN device, long before it gets written to disk. Certain applications will achieve significant performance boosts through fast write if the SAN implements it. Flash copy is an instantaneous copy capability available with some SAN devices. Actually copying the data may take time, but the SAN device can complete the physical copying after the logical copying. Being able to make copies is essential to any storage architecture. Often copies are used for purposes such as backup, or to allow parallel processing without contention. With flash copy capabilites from the SAN, the performance of copies can be greatly improved. Shared file systems are not part of the SAN architecture, but can be implemented on top of the SAN. Some recovery techniques such as HACMP rely on SAN technology to enable failover.While the Google file system provides similar capabilites, it is not currently integrated into most failover techniques.  Piloting innovations on a cloud Many companies are creating innovation initiatives and funding programs to develop innovation processes. Because innovation is an evolving topic, the team leaders often don’t know where to start. More often than not, they look at traditional or existing collaboration tools to try to meet the requirements for collaborative innovation. Through numerous engagements with clients, IBM has discovered that collaboration tools by themselves will not yield the desired results as effectively as having a structured innovation platform and program in place.IBM addressed this problem by developing a comprehensive innovation platform called Innovation Factory.This type of innovation platform enables innovation by putting a structure around the innovation process and providing tools for innovators and early adopters to publish, experiment, provide feedback, and enhance innovations. The Innovation Factory is a perfect complement to cloud computing because the innovators making new pilots and technologies available usually need servers or other computing resources in which to
• 11.
  develop, test, andprovide those services and applications to the early adopters. By combining cloud computing and Innovation Factory, or any other innovation platform already in use, a company can benefit from a complete solution that provides both physical computer resources and an innovation process combined with collaboration tools. Adding cloud computing to a company’s existing innovation process reduces the time needed to develop and deliver a product, reduces the barrier to entry, and reduces costs associated with procurement, setup,management, and reuse of physical assets.Cloud computing should be part of every innovation process when physical or virtual computer resources are needed for innovation pilots. Conclusion In today's global competitive market, companies must innovate and get the most from its resources to succeed. This requires enabling its employees, business partners, and users with the platforms and collaboration tools that promote innovation. Cloud computing infrastructures are next generation platforms that can provide tremendous value to companies of any size. They can help companies achieve more efficient use of their IT hardware and software investments and provide a means to accelerate the adoption of innovations. Cloud computing increases profitability by improving resource utilization. Costs are driven down by delivering appropriate resources only for the time those resources are needed. Cloud computing has enabled teams and organizations to streamline lengthy procurement processes. Cloud computing enables innovation by alleviating the need of innovators to find resources todevelop, test, and make their innovations available to the user community. Innovators are free to focus on the innovation rather than the logistics of finding and managing resources that enable theinnovation. Combining cloud computing with IBM Innovation Factory provides an end-to-end collaboration environment that could transform organizations into innovation power houses. References Innovation Factory: An integrated solution for accelerating innovation (October 2007) Service-oriented architecture: concepts, technology, and design T Erl - 2005 - Prentice Hall PTR Upper Saddle River, NJ, USA