DISTRIBUTED

COMPUTING

Subject Incharge :Sneha M. Yadav

Sneha M. Yadav
Sneha M. Yadav
INTRODUCTION
• A distributed system is a collection of independent computers that appear to the users of the system as a
single coherent system. These computers or nodes work together, communicate over a network, and
coordinate their activities to achieve a common goal by sharing resources, data, and tasks.

Sneha M. Yadav
DIFFERENCE BETWEEN CENTRALIZED
SYSTEM AND DISTRIBUTED SYSTEM
• All data and computational resources are kept and controlled in a single central place, such as a
server, in a centralized system. Applications and users connect to this hub in order to access and
handle data. Although this configuration is easy to maintain and secure, if too many users access it
simultaneously or if the central server malfunctions, it could become a bottleneck.

• A distributed system, on the other hand, disperses data and resources over several servers or
locations, frequently across various physical places. Better scalability and reliability are made
possible by this configuration since the system can function even in the event of a component failure.
However, because of their numerous points of interaction, distributed systems can be more difficult
to secure and administer.

Sneha M. Yadav
EXAMPLE OF A DISTRIBUTED SYSTEM
• Any Social Media can have its Centralized Computer Network as its Headquarters and computer
systems that can be accessed by any user and using their services will be the Autonomous Systems in
the Distributed System Architecture.

Sneha M. Yadav
COMPONENTS OF DISTRIBUTED SYSTEMS

• Distributed System Software: This Software enables computers to coordinate their activities and to
share the resources such as Hardware, Software, Data, etc.

• Database: It is used to store the processed data that are processed by each Node/System of the
Distributed systems that are connected to the Centralized network.

Definition: A distributed System is a collection of independent computers that appears to its

users as a single coherent systems.

Sneha M. Yadav
WORKING
OF
DISTRIBUT
ED
SYSTEMS

Sneha M. Yadav
CHARACTERISTICS OF DISTRIBUTED SYSTEM
• Resource Sharing: It is the ability to use any Hardware, Software, or Data anywhere in the System.

• Openness: It is concerned with Extensions and improvements in the system (i.e., How openly the software is
developed and shared with others)

• Concurrency: It is naturally present in Distributed Systems, that deal with the same activity or functionality
that can be performed by separate users who are in remote locations. Every local system has its independent
Operating Systems and Resources.

• Scalability: It increases the scale of the system as a number of processors communicate with more users by
accommodating to improve the responsiveness of the system.

• Fault tolerance: It cares about the reliability of the system if there is a failure in Hardware or Software, the
system continues to operate properly without degrading the performance the system.

• Transparency: It hides the complexity of the Distributed Systems to the Users and Application programs as
there should be privacy in every system.

Sneha M. Yadav
USE CASES OF DISTRIBUTED SYSTEM
• Finance and Commerce: Amazon, eBay, Online Banking, E-Commerce websites.

• Information Society: Search Engines, Wikipedia, Social Networking, Cloud Computing.

• Cloud Technologies: AWS, Salesforce, Microsoft Azure, SAP.

• Entertainment: Online Gaming, Music, youtube.

• Healthcare: Online patient records, Health Informatics.

• Transport and logistics: GPS, Google Maps.

Sneha M. Yadav
• The distributed system consist of Autonomous components and user
thinks that they are dealing with a single system.
• To support heterogenous computers and networks while offering a
single-system view, distributed systems are often organized by means
of layer of software that is logically placed between a higher –level
layer consisting of users and applications and a layer underneath
consisting of operating systems and basic communications facilities
such a distributed system is sometimes called as Middleware.

Sneha M. Yadav
 A distributed system organized as Middleware. The middleware layer extends over
multiple machines and offers each applications the same interface.

Sneha M. Yadav
• There are four networked computers and three applications, of which
application B is distributed across computers 2 and 3.
• Each application is offered the same interface.
• The distributed system provided the means for components of a single
distributed application to communicate with each other, but also to let
different applications communicate.
• At the same time ,it hides as best and reasonable as possible, the
differences in hardware and operating systems from each applications.

Sneha M. Yadav
CHARACTERISTICS OF DISTRIBUTED SYSTEM
• Resource Sharing: It is the ability to use any Hardware, Software, or Data anywhere in the System.

• Openness: It is concerned with Extensions and improvements in the system (i.e., How openly the software is
developed and shared with others)

• Concurrency: It is naturally present in Distributed Systems, that deal with the same activity or functionality
that can be performed by separate users who are in remote locations. Every local system has its independent
Operating Systems and Resources.

• Scalability: It increases the scale of the system as a number of processors communicate with more users by
accommodating to improve the responsiveness of the system.

• Fault tolerance: It cares about the reliability of the system if there is a failure in Hardware or Software, the
system continues to operate properly without degrading the performance the system.

• Transparency: It hides the complexity of the Distributed Systems to the Users and Application programs as
there should be privacy in every system.

Sneha M. Yadav
TRANSAPARENCY
•A distributed system that is able to present itself to users and
applications as if it were only a singe computer system is said
to be transparent.

Sneha M. Yadav
Sneha M. Yadav
Sneha M. Yadav
• Performance Transparency: Allows the system to be reconfigured to improve the
performance as the load varies.
• Scaling Transparency: A system should be able to grow without affecting
application algorithms. Graceful growth and evolution is an important requirement
for most enterprises.

Sneha M. Yadav
SCALABILITY:
The scalability of the system should remain efficient even with a significant increase in the number of
users and resources connected. It shouldn’t matter if a program has 10 or 100 nodes; performance
shouldn’t vary. A distributed system’s scaling requires consideration of a number of elements,
including size, geography, and management.
• Measures of Scalability:
➢ Size Scalability
➢ Geographical Scalability
➢ Administrative Scalability

Sneha M. Yadav
• Size Scalability: There will be an increase in the size of the system whenever users
and
resources grow but it should not be carried out at the cost of performance and
efficiency
of the system. The system must respond to the user in the same manner as it was
responding before scaling the system.
• Geographical Scalability: Geographical scalability refers to the addition of new
nodes in a
physical space that should not affect the communication time between the nodes.
• Administrative Scalability: In Administrative Scalability, significant management of
the
new nodes which are being added to the system should not be required. To
exemplify, if
there are multiple administrators in the system, the system is shared with others
Sneha M. Yadav
 MODULE 1:
TYPES OF DISTRIBUTED
SYSTEM
CLUSTER COMPUTING SYSTEMS
❑ Cluster computing is a type of distributed computing that involves the use of a cluster, which is a
group of interconnected computers that work together as a single system.

❑ In a cluster computing system as shown in the figure below , the computers in the cluster are
connected together by a high-speed network , and each computer has its own processing power,
memory, and storage.

❑ The main advantage of cluster computing is that it allows for the parallel processing of large amounts
of data and the execution of complex applications that require a lot of computational power.

❑ By dividing the workload among the computers in the cluster computing system can achieve better
performance and scalability than a single computer.
GRID COMPUTING
• Grid Computing can be defined as a network of computers working together to perform a task that
would rather be difficult for a single machine.
• All machines on that network work under the same protocol to act as a virtual supercomputer.
• The task that they work on may include analyzing huge datasets or simulating situations that require
high computing power.
• Computers on the network contribute resources like processing power and storage capacity to the
network.
• the subgroup consists of distributed systems, which are often set up as a network of computer systems,
each system can belong to a different administrative domain and can differ greatly in terms of
hardware, software, and implementation network technology.

• The different department has different computer with different OS to make the control node present
which helps different computer with different OS to communicate with each other and transfer
messages to work.
DISTRIBUTED INFORMATION SYSTEM
• Distributed Information System (DIS) is a type of information system where data,
processing, and computation are spread across multiple nodes or locations.
• The primary goal is to efficiently manage and provide access to information by
leveraging the advantages of distributed computing.
• DIS is often used to handle large-scale data, improve performance, enhance fault
tolerance, and support scalable architectures.
 DISTRIBUTED INFORMATION SYSTEMS
VS
DISTRIBUTED COMPUTING SYSTEMS
• While both Distributed Information Systems and Distributed Computing Systems
involve the distribution of tasks across multiple nodes, their primary focuses differ.

• DIS centers around the efficient management of information, while distributed

computing systems have a broader scope, encompassing various computing tasks and
applications beyond information management.
TRANSACTION PROCESSING SYSTEM
• A Transaction Processing System (TPS) is a type of information system that manages and processes
day-to-day transactional operations of an organization.

• It is designed to record, process, and store transactions in real-time, ensuring accuracy, consistency,
and reliability.

• TPS plays a crucial role in supporting core business activities such as order processing, inventory
management, and financial transactions.
Programming using transactions requires special primitives that must
either be supplied by the
underlying distributed system or by the language runtime system.
• Typical examples of transaction primitives are shown below
The main property of a transaction is either all of its operations are executed or none are executed.
The operations that are present in the body of transaction can be system calls, library procedures, or programming language
statements. Following are the ACID properties of transaction.
• Atomicity: Think of a transaction like a single operation or task. Atomicity ensures that either the entire task is completed, or
nothing happens. It's like a "all or nothing" rule for transactions.
• Consistency: This is about maintaining the correctness of your data. Imagine you're making changes to your data; consistency
ensures that your data remains sensible and valid throughout the entire process.
• Isolation: Picture a busy kitchen with multiple chefs. Isolation means that each chef can work on their recipe without interfering
with others. In databases, it ensures that one transaction doesn't mess with another happening at the same time.
• Durability: Once something is written to the database, it should stay there. Durability guarantees that once a transaction is
complete, the changes are permanent and won't be lost, even if the system crashes.
NESTED TRANSACTION

A nested transaction is a transaction that contains or is embedded within another transaction.

• This structure allows for a division of a complex task into smaller, more manageable units, with each
unit treated as a transaction.
• If an issue arises within a nested transaction, it can be handled independently without affecting the
outer transaction.
• It provides a way to structure and manage transactions in a hierarchical manner.
ENTERPRISE APPLICATION INTEGRATION
Enterprise Application Integration (EAI) refers to the process of connecting and coordinating various software
applications within an organization to work seamlessly together.
• The goal is to improve overall business efficiency, streamline processes, and enhance data flow across different departments
and systems.
1. Healthcare Information Systems Integration:
1. Scenario: Integration of Electronic Health Records (EHR) systems with laboratory information systems and billing systems.
2. Benefits: Improving patient care by ensuring that healthcare providers have access to complete and up-to-date patient
information, while also streamlining billing and administrative processes.
2. E-commerce Integration:
1. Scenario: Integration of an online store with inventory management, order processing, and customer support systems.
2. Benefits: Automatic updating of product availability, seamless order processing, and unified customer data across various
touchpoints.
DISTRIBUTED PERVASIVE SYSTEMS
Distributed Pervasive Systems are networks of devices or sensors that work together seamlessly to
gather and share information in our surroundings.

• These systems are all around us, and they often involve various devices (like smartphones, sensors,
and smart appliances) communicating with each other to provide helpful services.

• Think of it as a smart and interconnected environment where devices collaborate to make our lives
easier and more efficient. Examples include smart homes, where thermostats, lights, and security
systems communicate to create a comfortable and secure living space.
TYPES OF DISTRIBUTED COMPUTING
SYSTEM MODELS
• A physical model is basically a representation of the underlying hardware elements of a
distributed system.
• It encompasses the hardware composition of a distributed system in terms of computers
and other devices and their interconnections.
• It is primarily used to design, manage, implement and determine the performance of a
distributed system.

Sneha M. Yadav
MINICOMPUTE
R MODEL

Sneha M. Yadav
• The minicomputer model is a simple extension of the centralized time-sharing system.
• A distributed computing system based on this model consists of a few minicomputers interconnected
by a communication network were each minicomputer usually has multiple users simultaneously
logged on to it.
• Several interactive terminals are connected to each minicomputer. Each user logged on to one
specific minicomputer has remote access to other minicomputers.
• The network allows a user to access remote resources that are available on some machine other than
the one on to which the user is currently logged. The minicomputer model may be used when
resource sharing with remote users is desired.
• The early ARPA net is an example of a distributed computing system based on the minicomputer
model.

Sneha M. Yadav
WORKSTATIO
N MODEL

Sneha M. Yadav
• A distributed computing system based on the workstation model consists of several
workstations interconnected by a communication network.
• An organization may have several workstations located throughout an infrastructure where
each
workstation is equipped with its own disk & serves as a single-user computer.
• In such an environment, at any one time a significant proportion of the workstations are idle
which
results in the waste of large amounts of CPU time.
• Therefore, the idea of the workstation model is to interconnect all these workstations by a
high-speed.
• LAN so that idle workstations may be used to process jobs of users who are logged onto other
workstations & do not have sufficient processing power at their own workstations to get their
jobs processed efficiently.
• Example: Sprite system & Xerox PARC
Sneha M. Yadav
WORKSTATION–SERVER MODEL
Sneha M. Yadav
• The workstation model is a network of personal workstations having its own disk & a local file system.
• A workstation with its own local disk is usually called a diskful workstation & a workstation without a
local disk is called a diskless workstation. Diskless workstations have become more popular in network
environments than diskful workstations,making the workstation-server model more popular than the
workstation model for building distributed computing systems.
• A distributed computing system based on the workstation-server model consists of a few
minicomputers & several workstations interconnected by a communication network.
• In this model, a user logs onto a workstation called his or her home workstation. Normal computation
activities required by the user’s processes are performed at the user's home workstation, but requests
for services provided by special servers are sent to a server providing that type of service that performs
the user's requested activity & returns the result of request processing to the user's workstation.
• Therefore,in this model,the user's processes need not migrated to the server machines for getting the
work done by those machines.
• Example:The V-System.

Sneha M. Yadav
PROCESSOR–POOL MODEL:
Sneha M. Yadav
• The processor-pool model is based on the observation that most of the time a user
does not need any computing power but once in a while the user may need a very large
amount of computing power for a short time.
• Therefore, unlike the workstation-server model in which a processor is allocated to
each user,in processor-pool model the processors are pooled together to be shared by
the users as needed.
• The pool of processors consists of a large number of microcomputers & minicomputers
attached to the network.
• Each processor in the pool has its own memory to load & run a system program or an
application program of the distributed computing system.
• In this model no home machine is present & the user does not log onto any machine.
• This model has better utilization of processing power & greater flexibility.
• Example:Amoeba & the Cambridge Distributed Computing System.
Sneha M. Yadav
HYBRID MODEL
• The workstation-server model has a large number of computer users only performing
simple interactive tasks &-executing small programs.
• In a working environment that has groups of users who often perform jobs needing
massive computation, the processor-pool model is more attractive & suitable.
• To combine Advantages of workstation-server & processor-pool models, a hybrid
model can be used to build a distributed system.
• The processors in the pool can be allocated dynamically for computations that are too
large or require several computers for execution.
• The hybrid model gives guaranteed response to interactive jobs allowing them to be
more processed in local workstations of the users

Sneha M. Yadav
HARDWARE AND SOFTWARE CONCEPTS

HARDWARE CONCEPTS:

• HARDWARE IN DISTRIBUTED SYSTEMS CAN BE

ORGANIZED IN SEVERAL DIFFERENT WAYS:

• SHARED MEMORY
(MULTIPROCESSORS , WHICH HAVE A
SINGLE ADDRESS SPACE).

• PRIVATE MEMORY
(MULTICOMPUTER, EACH CPU HAS A DIRECT
CONNECTION TO ITS LOCAL MEMORY).

Sneha M. Yadav
MULTIPROCESSOR • Have limited scalability

S – BUS BASED • Cache Memory help avoid bus overloading.

Sneha M. Yadav
MULTIPROCESSOR • Different CPUs can access different memories
simultaneously
S – SWITCH BASED • The number of switches limits the number of CPUs that
can access memory simultaneously
a) A crossbar switch
b) An omega switching network

Sneha M. Yadav
MULTICOMPUTERS :-
Homogeneous:
• All CPUs and memory are identical;
• Connected through a broadcast shared multi access network (like Ethernet) in bus based
systems;
• Messages routed through an interconnection network in switch-based multicomputer.
Heterogeneous:
• The most usual topology;
• Computers may vary widely with respect to processor type, memory size, I/O bandwidth;
• Connections are also diverse (a single multicomputer can simultaneously use LANs, Wide
Area ATM, and frame relay networks);
• Sophisticated software is needed to build applications due to the inherent heterogeneity;
• Examples: @gmail.com, WWW...

Sneha M. Yadav
SOFTWARE CONCEPTS :-
• Thesoftware of the distributed system is nothing but selection of different operating
system
platforms.
• The operating system is the interaction between user and the hardware.
• There are three largely used operating system types:
• a) Distributed operating system
• b) Network operating system
• c) Middleware operating system

Sneha M. Yadav
DISTRIBUTED OPERATING SYSTEM:
• It is different from multiprocessor and multicomputer hardware.
• Multiprocessor- uses different system services to manage resources connected in a system and use system calls to communicate
with the processor.
• Multicomputer- the distributed Operating system uses a separate uniprocessor OS on each computer for communicating between
different computers.
• In distributed OS, a common set of services is shared among multiple processors in such a way that they are meant to
execute a distributed application effectively and also provide services to separate independent computers connected in a
network as shown in fig below
• It communicates with all the computer using message passing interface(MPI).
• It follows the tightly coupled architecture pattern.
• It uses Data structure like queue to manages the messages and avoid message loss between sender and receiver computer.
• Eg: Automated banking system, railway reservation system etc.

Sneha M. Yadav
NETWORK OPERATING SYSTEM:

• It is specifically designed for hetrogeneous multicomputer system, where multiple hardware

and
network platforms are supported.
• It has multiple operating system running on different hardware platforms connected in
network.
• It provides to each computer connected in network.
• It follows the loosely coupled architecture pattern which allow user to use services provided
by
the local machine itself as shown in fig below.
• Eg Remote login where user workstation is used to log in to the remoter server and execute
remote commands over the network.
• Eg Centralized file storage system.
Sneha M. Yadav
Advantage:
It has scalability feature, where large number of resources
and users are supported.
Disadvantage:
It fails to provide a single coherent view.

Sneha M. Yadav
MIDDLE WARE OPERATING SYSTEM:
In distributed systems, middleware is a software component that provides services
between two
or more applications and can be used by them.
• Middleware can be thought of as an application that sits between two separate
applications and
provides service to both.
• With all the miscommunication going around these days, it is vital for enterprises to
start using
software solutions that streamline communications across departments.
• One such product that fits this description, is known as Middleware, which allows
organizations
to implement their processes seamlessly by integrating all components of the enterprise.
Sneha M. Yadav
Sneha M. Yadav
CLIENT AND
SERVER MODEL
A client and server networking model is a
model in which computers such as servers
provide the network services to the other
computers such as clients to perform a user
based tasks. This model is known as client-
server networking model.

• The application programs using the client-

server model should follow the given below
strategies:

Sneha M. Yadav
Client
• A client is a program that runs on the local machine requesting service from the server. A client
program
is a finite program means that the service started by the user and terminates when the service is
completed.
Server
• A server is a program that runs on the remote machine providing services to the clients. When the
client
requests for a service, then the server opens the door for the incoming requests, but it never initiates
the service.
• A server program is an infinite program means that when it starts, it runs infinitely unless the problem
arises. The server waits for the incoming requests from the clients. When the request arrives at the
server, then it responds to the request.

Sneha M. Yadav
 Thank You

Sneha M. Yadav