Data Centre Infrastructure Design and Performance
Data Centre Infrastructure Design and Performance
6,200
Open access books available
169,000
International authors and editors
185M
Downloads
154
Countries delivered to
TOP 1%
most cited scientists
12.2%
Contributors from top 500 universities
Abstract
1. Introduction
Meza is one of the home-grown data centre companies, and it provides various services
which include top-level security and reliable data management and IT infrastructure
management. Meza is expected to be built in several data centres across Malaysia. A
Malaysian food delivery application company has more than 5 million users of the services,
and the number of users is increasing day by day. The current infrastructure is insufficient
to handle the vast amount of data processing, and it might cause the users to face poor user
experience due to longer response time from the server and slow process. Therefore, the
company has appointed Meza to construct a data centre to cater to the continued growth of
the company. The data centre will be required to process online food ordering and online
payment, customer relationship management to manage the communication in one inbox
and engage with their client.
1
Latest Advances and New Visions of Ontology in Information Science
This chapter will be proposing a data centre design with the essential components
for this food delivery application company and analysing, synthesising and evaluat-
ing each component of the proposed data centre. Other data centre components,
such as power usage effectiveness and efficiency, cooling system and protection,
have been discussed in the chapter Data Centre Infrastructure Power Efficiency and
Protection (Figure 1).
2. Analysis
The first basic requirement that comes to mind when building a data centre is
the customer requirements. The customers are an essential entity. This data centre
proposal has been designed to accept enormous amount of traffic loads, which means
that many customers can order at the same time without the need to face frustration
which happens when a system crashes due to overload. Furthermore, a seamless
online chat function has been proposed which functions from the time of the order
till the order has been delivered. This feature will enable customers to be more confi-
dent to use this delivery system as they can raise any issues regardless of the payment,
order and so on. This is possible due to the new proposed network infrastructure.
Moreover, due to its newly improved network infrastructure, orders can be
grouped more efficiently and can be delivered quickly. Lastly, the data centre is
designed to be transparent which will allow both the customers and the delivery guy
to key in ratings, which will compel the individuals to be reputable in order to achieve
perks and hence make the system more trustworthy.
Figure 1.
APU data centre.
2
Data Centre Infrastructure: Design and Performance
DOI: http://dx.doi.org/10.5772/intechopen.109998
Moving on, there are a few requirements for a data centre to be robust such as:
• Scalability: The food-ordering application company has more than 5 million active
users and is increasing with time. The planned data centre will also be able to offer
Figure 2.
Some features of different data centre tiers [4].
3
Latest Advances and New Visions of Ontology in Information Science
Figure 3.
Some features of different data centre tiers [5].
continuous scalability and colocation facilities. This is the most critical aspect in
constructing data centres, because expansion capability and the handling of addi-
tional data or customers are necessary which may impact the architecture of data
centre in long run if scalability is not taken into account. Any future change in the
data centre which requires more space, devices or other technical aspect must be
effectively managed without affecting the key existing data centre elements.
• Security: The data centre is required to store the client information and process
online payment and the orders of their customers. The process which the data
centre will be handling the most will be the payment process and the orders, in
which the payment should be done in the most secure way. It is also critical that
the proposed data centre has the highest data protection standards. In order to
ensure both internal and external threats, the data security must include cyber
security measures and physical security. The advantages of a high-security data
centre ensure data integrity and keep trust between customers. As a data centre
hosts information, software and facilities that companies use every day, organ-
isations must ensure that they utilise adequate data centre protection. Lack of
effective data centre protection may contribute to privacy abuse when confiden-
tial information regarding the business is leaked or compromised.
Figure 4.
A commercial DCIM software developed by Intel [8].
distribution units, servers and network switches to name a few. A typical data centre has
a lot of workload. The workload increases immensely depending on the size of the data
centre. For the food delivery company with millions of users, the data centre will have a
huge workload if managed manually, and it would be unrealistic and impossible to run
effectively. DCIM does tasks which are otherwise performed by data centre personnel.
An important feature of DCIM is the real-time [10] central dashboard which displays
information about critical systems from sensors and equipment. Data centre personnel
are more informed about the operations and are likely to predict the next outage and
avoid it. In addition to this, DCIM can handle non day-to-day tasks such as management
of change. Therefore, DCIM is a critical piece of software for improving data centre
manageability. The use of DCIM by Meza in this data centre will have huge benefits,
resulting in less downtime and making manageability more robust (Figure 5).
Since cabling performance is a major factor in system outages, Meza will be using
cabling from providers that ensure their cables can sustain higher performance.
Meza hopes that using high-quality data centre fabric can reduce system outages and
increase the overall manageability of the data centre.
• Cost: All business organisations strive to put the best performance with the
lowest possible cost. It is the interest of both Meza and the food delivery com-
pany to bring the cost down while meeting business requirements. Total Cost
of Ownership (TCO) is an estimate which includes the building the data centre
and operating it. For the food delivery company, it is necessary that the TCO of
building and operating a data centre is lower compared to hosting their applica-
tion on a public cloud such as Amazon Web Services (AWS). According to [12],
the largest driver of cost is determined to be the unnecessary unabsorbed costs
5
Latest Advances and New Visions of Ontology in Information Science
resulting from the oversizing of the infrastructure. Meza has decided to deploy
an adaptable physical infrastructure system. An adaptable physical infrastruc-
ture system reduces the waste due to oversizing substantially. As a result, the
total cost of ownership is reduced too (Figure 6).
Figure 5.
Cabling contributes to large number of system outages [11].
Figure 6.
Charts showing waste due to oversizing between non-adaptable (a) and adaptable (b) approaches [13].
6
Data Centre Infrastructure: Design and Performance
DOI: http://dx.doi.org/10.5772/intechopen.109998
infrastructure equipment, so they can change the equipment before they become
faulty without compromising additional equipment due to failure.
2.3 Environment
Figure 7.
(NTT, ND).
Figure 8.
The environment of Cyberjaya [15].
7
Latest Advances and New Visions of Ontology in Information Science
Figure 9.
Illustrate the proposed data centre floor plan.
The above data centre floor plan design consists of 8 unique components that are
necessary for a data centre including a surveillance room for monitoring the physical
security and to create daily reports and analytics. The components that have been
included are:
• Electrical supply: it is used to provide electricity for the entire data centre.
• Cooling system: it has been placed to provide cooling for the server racks and to
avoid overheating when the computing resources are in use.
• Computing resources: they are responsible for handling all the processing powers
for the database and to help with communications between the clients and the
customers.
• Sever racks: it is used for the space allocation for the computing resources.
8
Data Centre Infrastructure: Design and Performance
DOI: http://dx.doi.org/10.5772/intechopen.109998
Figure 10.
Racks inside a data centre [17].
• Storage infrastructure: this is where all the information is stored like details
about the restaurant menu, customer credentials and so on.
• Fire supressing system: in the event of any components catching fire, this system
will be responsible for supressing it.
Furthermore, the data centre has been equipped with an Uninterruptible Power
Supply (UPS) backup battery and a diesel generator in case of a power failure in order
to achieve a higher availability for the system. Lastly, state-of-the art closed circuit
television (CCTV) has also been placed in the data centre cabinet to be monitored
remotely by higher officials (Figure 10).
4.1 Racks
9
Latest Advances and New Visions of Ontology in Information Science
racks in data centres today play a vital role in mounting heavy IT equipment, provid-
ing an organised environment for power distribution, air flow distribution for better
cooling performance and cable management among many features [18]. Data centres
demand a rack infrastructure that can mount a variety of equipment such as servers
and switches. Therefore, it is important that the rack infrastructure can meet the
requirements while offering sustainable performance.
The major equipment inside the rack will be the compute servers, storage serv-
ers and networking equipment such as switches. Different racks will have different
compositions of these equipment.
• Compute servers
The main compute resources in a data centre are the servers. Most of the racks will
be utilised for mounting rack servers for compute purposes. These servers are used
for compute-intensive tasks such as processing and database hosting. These servers
will be using enterprise-level processors such as Intel Xeon or AMD EPYC which have
multiple physical cores providing high-level performance.
• Storage servers
Similar to compute rack servers, storage servers are mounted in the racks. Storage
servers have a high density of storage capacity such as hard disks and SSDs. The
emphasis on processing power in storage servers compared to compute servers is less.
Therefore, storage servers typically use much less RAM and less performant proces-
sors. More on storage infrastructure will be discussed in this proposal.
• Switches
Switches act like a hub which connects different equipment such as servers in the
rack with other servers or racks in the data centre. They are an integral part of the
networking infrastructure.
Selecting a rack for a data centre requires consideration into some criteria such
as dimension, design, capacity and material. According to [19], rack is available in
three major types: open frame racks, rack enclosures or cabinets and wall-mount
racks (Figure 11).
Rack enclosures or cabinets are a rack with four posts, doors and panels on the
side. Depending on the design and manufacturer, the side panels can be removed to
offer maximum flexibility. Among the most distinctive features of rack enclosures
are airflow management, security, cable management and power distribution. These
types of rack are ideal for use cases where the rack needs to store heavier equipment,
hotter equipment and higher wattages per rack [19]. Doors that are on the front and
back of the rack are ventilated for better airflow. Additionally, doors provide some
levels of security. Most rack enclosures come with doors that can be locked which
provide an additional layer of security (rack-level). Rack enclosures have a means of
10
Data Centre Infrastructure: Design and Performance
DOI: http://dx.doi.org/10.5772/intechopen.109998
Figure 11.
42 U rack enclosure or cabinet [20].
providing dedicated power distribution units (PDU) for the rack. The PUDs in rack
enclosures are installed at the back or on the side, so they provide power without
congesting the space inside the rack.
The size of the rack depends on many attributes. Some of these include:
4.1.3 Justification
Based on the three types of racks, rack enclosures or cabinets will be used across
the data centre. Since the data centre is going to be a newly built, wall-mount racks
11
Latest Advances and New Visions of Ontology in Information Science
Figure 12.
Top-of-rack vs. end-of-row architecture [23].
can be avoided because there is enough floor space inside the data centre for the
planned capacity. Compared to a wall-mount rack, the other two racks provide more
racking of equipment for a given floor space. While open-frame racks offer a lot of
features for a much lower cost than rack enclosures, the features such as better airflow
control and better security are too important to be overlooked. Open-frame racks
offer very little control over airflow. In addition to this, the use of side panels in rack
enclosures prevents unrestricted hot air flowing inside the rack, heating up the equip-
ment unnecessarily. According to [21], between 30 and 55% of a data centre’s energy
consumption goes into powering its cooling and ventilation systems. It is important
that the racks chosen for the data centre can lower the cost of overall cooling as much
as possible. In general, low cost racks such as open-frame racks have a significant
effect on how much time it takes to complete rack-based work due to inefficiencies in
areas such as cable management or mounting [18]. In [22], a decision support model
has been proposed to the use of liquid-based cooling to measure and assess the waste
heat resource accessible from retrofit within the High Performance Computing (HPC)
and data centre (DC) industry (Figure 12).
As the data centre will be using top-of-rack switching, the use of networking racks
will be limited. Top-of-rack switching architecture is considered for this data centre
because it provides the benefit of better cabling, future-proofing with emerging
standards and better support for multi-core servers by offering more bandwidth with
low latency [24, 25]. Top-of-rack architecture avoids the number of cables going to the
networking server considerably. Therefore, the size of racks in the data centre will be
consistent.
Based on the consideration of attributes, the data centre will be using the stan-
dard 42 U tall, 600 mm wide and 1070 mm deep racks. Most servers mounted in
the server will be 2 U. 2 U servers offer more advantages than a smaller 1 U server
or oversized 5 U server. Due to limitation of physical size, 1 U server is affected by
heating issues. While, 5 U servers are more powerful, they are more expensive and
less cost-effective. Therefore, 2 U servers offer a compromise between performance
and cooling [26]. When using standard equipment, the oversizing of data centre is
not necessary. 42 U tall racks also provide several additional benefits [18]:
12
Data Centre Infrastructure: Design and Performance
DOI: http://dx.doi.org/10.5772/intechopen.109998
In conclusion, 42 U rack enclosures provide better features and are more suitable
to be used in this data centre.
Figure 13.
Storage area network [28].
13
Latest Advances and New Visions of Ontology in Information Science
designed infrastructure could lower the performance of the overall data centre as data
can be used in other areas like compute. The storage infrastructure in the data centre
must be able to handle these requirements while overcoming the challenges faced.
Traditionally, data centres use 3 popular storage solutions [27] (Figure 13).
• Host components
These components are located in the computer servers or any other type of server
accessing the SAN. Compute servers (hosts) use a host-based adapter (HBA) which has a
fabric port that enables communication between the server (host) and SAN switches.
Figure 14.
SAN component layers [30].
14
Data Centre Infrastructure: Design and Performance
DOI: http://dx.doi.org/10.5772/intechopen.109998
• Fabric components
• Storage components
The fundamental parts of any SAN are the storage components. Storage compo-
nents are the storage arrays. Storage arrays contain storage processors which com-
municate with disk arrays. In this proposed data centre’s storage infrastructure, the
SAN will use SSD disk arrays. SSDs are one of the fastest storage mediums available
today (Figure 15).
The SAN will use Core-Edge topology which is based on the switched fibre
channel. The two most important traits of Core-Edge topology are the resiliency and
performance that this topology provides. In this topology, two or more core switches
are used to interconnect two or more edge switches. Edge switches can be the switches
that connect with core switches from servers or disk arrays. In addition to this, the use
of this topology in SAN will encourage a balance between usable ports and dedicated
inter-switch communication [31].
Figure 15.
Core-edge SAN topology [31].
15
Latest Advances and New Visions of Ontology in Information Science
4.2.2 Justification
Based on the comparisons made above, Meza’s new data centre will be using a
Storage Area Network (SAN). The growing food delivery company’s active users
are increasing, and they require a scalable storage solution. Therefore, DAS with no
scalability cannot be chosen. While NAS is cheaper and easier to maintain, SAN offers
better performance. For a large organisation and data centre, SAN is ideal. Another
key factor is that SAN works with virtualisation [32]. Virtualisation is a popular tech-
nology not only used in data centres but also heavily used even today. Other benefits
of SAN include improved storage utilisation, better data protection and recovery and
elimination of network bottlenecks [33].
A key difference in how data is stored is that SAN uses block-level storage, while
NAS uses file-level storage. The biggest advantage of block-level storage is that it
offers better access and control privileges. This is critically important since the food
delivery company already has 5 million users, and easier management of users’ files is
a key business requirement.
As for the SAN technology, Meza will be choosing the Fibre Channel (FC).
The key factor in making this decision is that FC provides significantly better
performance and reliability. For such a scale of growing 5 million active user base,
performance and reliability are crucial. It is possible to build a storage network
of thousands of nodes without affecting throughput and latency. In addition to
this, the SAN will use arrays of SSDs instead of HDDs (Figure 16). SSDs provide
significant increase in speeds, and the price difference between the two has nar-
rowed over the past few years [34].
The topology for SAN infrastructure used is Core-Edge. According to [35], SAN
designs should always use two isolated fabrics for high availability. Since this data
centre is a tier 4 data centre, high availability and resiliency are crucial. One of the
reasons why Core-Edge FC is selected is because point-to-point or FC-AL does not
have high availability, as in if case one link fails, the entire storage network becomes
Figure 16.
SSDs have higher read and write speeds over HDDs [34].
16
Data Centre Infrastructure: Design and Performance
DOI: http://dx.doi.org/10.5772/intechopen.109998
5. Conclusion
We can conclude by saying that the world of IT is constantly increasing, and this
will never stop the demand for innovative and better solutions. There is no question
that future confirmation of the solution and equipment chosen for this task is same.
From security to smart execution, the planned data centre is carefully considered.
Scalability, CO2 reduction, system resilience, sustainability, applying machine
learning and other emerging technologies are important to be considered for the data
centre design. Moreover, the colocation system allows clients to locate their data by
renting a space in the data centre and choosing the equipment. The focus on this role
should be incredibly strong if carried out and can make sure every requirement of the
food ordering system is encountered.
Conflict of interest
Author details
Yaseein Soubhi Hussein1*, Maen Alrashd2,Ahmed Saeed Alabed1 and Saleh Alomar2
© 2023 The Author(s). Licensee IntechOpen. This chapter is distributed under the terms of
the Creative Commons Attribution License (http://creativecommons.org/licenses/by/3.0),
which permits unrestricted use, distribution, and reproduction in any medium, provided
the original work is properly cited.
17
Latest Advances and New Visions of Ontology in Information Science
References
[7] Sadri AA, Rahmani AM, [15] Richard. Essential Information about
Saberikamarposhti M, Hosseinzadeh M. Cyberjaya - Malaysia’s Technology and
Fog data management: A vision, Innovation Hub. 2019
challenges, and future directions. Journal
[16] Hussein Y, Alrashdan M. Secure
of Network and Computer Applications.
payment with QR technology on
2021;174:1-24
university campus. Journal of Computer
Science & Computational Mathematics.
[8] Intel. Intel® Data Center Manager.
2022;12:31-34
2020. Available from: https://www.intel.
com/content/www/us/en/software/ [17] Facebook. Opening our Newest Data
intel-dcm-product-detail.html Center in Los Lunas, New Mexico. 2019.
Available from: https://engineering.
[9] Gartner. Data Center Infrastructure fb.com/data-center-engineering/
Management (DCIM). 2020. Available los-lunas-data-center/
from: https://www.gartner.com/en/
information-technology/glossary/data- [18] Pearl H, Wei Z. How to Choose an
center-infrastructure-management-dcim IT Rack. 2015. Available from: https://
18
Data Centre Infrastructure: Design and Performance
DOI: http://dx.doi.org/10.5772/intechopen.109998
[20] Tripp Lite. 42U SmartRack Standard- [29] RedHat. What is Network-Attached
Depth Rack Enclosure Cabinet with Storage?. 2020. Available from: https://
Doors, Side Panels & Shock Pallet www.redhat.com/en/topics/data-storage/
Shipping. 2020. Available from: https:// network-attached-storage
www.tripplite.com/42u-smartrack-
standard-depth-rack-enclosure- [30] VMware. SAN Conceptual and
cabinet-doors-side-panels-shock-pallet- Design Basics. 2016. Available from:
shipping~SR42UBSP1 https://www.vmware.com/pdf/esx_san_
[21] DataSpan. Data Center Cooling
cfg_technote.pdf
Costs. 2019. Available from:
[31] Gençay E. Configuration Checking
https://www.dataspan.com/blog/
data-center-cooling-costs/ and Design Optimization of Storage
Area Networks. 2009. Available
[22] Ljungdahl V, Jradi M, Veje C. A from: https://www.researchgate.net/
decision support model for waste heat publication/314245428_Configuration_
recovery systems design in data Center Checking_and_Design_Optimization_of_
and high-performance computing Storage_Area_Networks
clusters utilizing liquid cooling and
phase change materials. Applied Thermal [32] Bauer R. What’s the Diff: NAS
Engineering. 2022;201:1-10 vs SAN. 2018. Available from:
https://www.backblaze.com/blog/
[23] Parés C. Top of the Rack vs whats-the-diff-nas-vs-san/
End of The Row. 2019. Available
from: https://blogs.salleurl.edu/en/ [33] Robb D. Storage Area Networks in
top-rack-vs-end-row the Enterprise. 2018. Available from:
https://www.enterprisestorageforum.
[24] Juniper Networks. Next Steps
com/storage-networking/storage-area-
Toward 10 Gigabit Ethernet Top-of-Rack
networks-in-the-enterprise.html
Networking. 2016. Available: https://
www.juniper.net/us/en/local/pdf/
[34] Rubens P. SSD vs. HDD Speed.
whitepapers/2000508-en.pdf
2019. Available from: https://www.
[25] Hussein YS. Impact of applying enterprisestorageforum.com/storage-
channel estimation with different levels hardware/ssd-vs-hdd-speed.html
of DC-bias on the performance of
visible light communication. Journal of [35] Singh S. Core-Edge and Collapse-
Optoelectronics Laser. 2021;40 Core SAN Topologies. 2017. Available
from: https://community.cisco.com/
[26] Thinkmate. 2U Rack Server. 2017. t5/data-center-documents/core-edge-
Available from: https://www.thinkmate. and-collapse-core-san-topologies/
com/inside/articles/2u-rack-server ta-p/3149001
19