EC2-and-File-Systems.pptx
EC2-and-File-Systems.pptx
Solutions Architect
Associate C03
Module 2
Elastic Compute
Cloud and File
Systems
1. Global Infrastructure
Agenda 2.
3.
Amazon EC2
5. Amazon FSx
The Amazon Web Services (AWS) infrastructure is organized into regions and availability zones, which are
fundamental concepts for designing fault-tolerant and highly available applications and providing global
reach.
AWS Region
Availability Zone 3
Amazon Elastic Compute Cloud (EC2) is a cloud computing service provided by AWS that offers resizable
compute capacity in the cloud. It allows users to launch and manage virtual servers, called instances, on the
AWS infrastructure.
Elasticity refers to the ability of a cloud computing system to dynamically adjust its capacity to handle
changing workloads. This means that resources such as compute, storage, and networking can be
automatically scaled up or down based on demand, allowing users to efficiently use resources and pay only for
what they consume.
Auto-Scaling Amazon S3
Elastic Services
Amazon RDS
Elastic Load Balancing
1
Instances Instance Types
6
Virtual servers, hosted The different
in the cloud, can be configurations
customized to run available for users
different operating to launch and run
systems. their applications.
2
Amazon Machine Images Key Pairs
5
Pre-configured Key pairs are used
templates that for secure access
contain to EC2 instances.
configurations and
operating systems to
4 33
launch instances.
Elastic Block Store Load Balancing
EBS provides Distributes incoming
persistent block-level application traffic
storage volumes that across multiple EC2
can be attached to instances to improve
EC2 instances. availability.
Compute Memory
Optimized Optimized
Compute optimized Memory optimized
instances are designed instances are ideal for
for applications that applications that require
require a large amount of
high-performance memory.
processors.
Storage Accelerated
Optimized Computing
These instances are
Accelerated computing
designed for workloads
instances use hardware
that require high,
accelerators, or
sequential read and
co-processors, to perform
write access to very large
functions.
Instance Types data sets on local
storage.
Cluster Partition
Instances spread across partitions
Instances placed in close proximity
within one or more clusters for
within a single Availability Zone for
large-scale distributed and
low-latency communication
replicated workloads
Spread
Instances spread across
distinct underlying hardware
to minimize correlated
failures
● Launch Instance
● Launch Instance
The Amazon Elastic Block Store (EBS) provides persistent block-level storage volumes for use with Amazon
EC2 instances. It offers reliable, low-latency storage that can be easily attached to and detached from EC2
instances. EBS volumes support various performance options and features, including snapshots for backups
and encryption for security.
S
EB
An EBS volume is
automatically Throughput
replicated.
Volume Types
availability zone.
Attach volume.
Attach volume.
Mounting Volumes :
For Linux
● Use lsblk to list available block devices and identify the attached volume.
For Windows
EBS 1 Instance 1
Instance 1
EBS
EBS 2 Instance 2
Instance 2
Point-in-Time Recovery
Backup Solution
Volume Cloning
Incremental Backups
Encryption
- Select the volume you wish to create a snapshot of for Volume ID.
- Open the AMI section and select your AMI once created, click `Launch Instance from AMI`.
- On the Launch the instance page, provide a name for your instance.
- Finally, launch the instance by referring to the steps in Hands-On 1: Launch and Connect to
An Amazon Machine Image – AMI provides the information required to launch an instance, which is a virtual
server in the cloud. An AMI is basically a template and can be used to launch as many instances as needed.
Within a VPC, instances can be launched from as many different AMIs
Launch Permissions
A Block Device
The lifecycle of an Amazon Machine Image (AMI) in AWS involves several stages, from creation to eventual
deprecation. Here's an overview of the typical AMI lifecycle:
Launch
Instance
Create Register
Copy
AMI #2
Deregister
- Sign in to the AWS Management Console and open the Amazon EC2 console.
AWS EFS (Elastic File System) is a scalable, fully managed file storage service for EC2 instances, supporting
NFSv4 protocols. It provides elastic capacity and performance, allowing multiple instances to access shared file
data simultaneously. With automatic scaling and high availability, EFS simplifies file storage for applications
and workloads requiring shared access.
A file system is a method used by operating systems and software to organize and store data on storage
devices such as hard drives, solid-state drives (SSDs), or network storage. It provides a structured way to store,
retrieve, and manage files and directories.
A mount target is a network endpoint that allows Amazon EC2 instances or on-premises servers to connect to
an EFS file system. Mount targets are used to facilitate the mounting of an EFS file system on EC2 instances or
servers, enabling them to access and interact with the shared file system.
Elastic File System (EFS) allows you to choose between two deployment options: Regional and One Zone. Each
option has its own advantages and considerations, depending on your specific requirements and use case.
Regional
One Zone
● Better Availability
● Cost-effective
● Designed for Durability
● Deployed within single AZ
● High throughput and low
● low latency within same AZ
latency access
Scalability
Fully Managed
High Availability
Encryption
Elastic File
01 It is used by database System
applications those who
depends upon random reads
and random reply. 01 Performance varies
based on the selected
performance mode
It is primarily used for data
02
that must be quickly
accessible while also being
long- Automatically scales to
02
lasting. accommodate growing
storage needs
03 Ideal for block-level
storage attached to
individual EC2 instances
03 Suitable for shared file
storage accessible by
Elastic Block multiple EC2
Store
Development Testing
Environments Environments
Content
Big Data
Repositories
Instance Instance
- Sign in to the AWS Management Console and open the Amazon EFS console.
- Choose "Create."
- Open a terminal window on your EC2 instance through Secure Shell (SSH) or EC2 instance
connect.
- Create a directory that you will use as the file system mount point (e.g., `sudo mkdir efs`).
- Run the following commands to mount your file system. Navigate to "Mount via DNS" -> "Using
Amazon FSx is a fully managed file storage service that provides high-performance file systems compatible
with Windows and Lustre for compute-intensive workloads. It offers features like automatic backups, data
deduplication, and integration with AWS services, simplifying file storage management for applications
requiring shared access and low-latency performance.
High-Performance
Windows File Sharing
Computing
Simple and
Fully
Managed 1
2 Fast Delivery
Highly
available
3
Secure and
4 Compliant
Easy
Integration 5
Amazon FSx lets you choose between four widely-used file systems:
Amazon FSx for NetApp ONTAP delivers fully managed, highly available, and scalable file storage with
enterprise-grade features. It provides familiar data management capabilities, such as snapshots, cloning, and
replication, enabling seamless integration with existing NetApp ONTAP ecosystems while offering the
elasticity and cost-effectiveness of the AWS cloud.
Amazon FSx for OpenZFS is a fully managed file storage service that makes it easy to move data residing in
on-premises ZFS or other Linux-based file servers to AWS without changing your application code or how you
manage data.
Amazon FSx for Windows File Server provides fully managed Microsoft Windows file servers. Amazon FSx
has native support for Windows file system features and for the industry-standard Server Message Block
(SMB) protocol to access file storage over a network, with native Windows compatibility, and consistent
sub-millisecond latencies.
WorkSpaces
Instances
VMware Cloud on
AWS Environments
AppStream 2.0
Instances
Native Windows
Compatibility DFS Namespace Integrates with
DFS Replication Microsoft AD
Built on SSD
High Throughput
Storage
High IOPS
● Choose Amazon FSx for Windows File Server and click Next.
● Choose Multi-AZ for Deployment type and specify minimum storage capacity (32 GiB).
● In the Network & security section, select your VPC and VPC Security Groups.
● Click Next.
● Choose AWS Managed Microsoft Active Directory, select directory, click Next.
● Open Internet Protocol Version 4 settings and change DNS server addresses.
● Select drive letter, provide file system DNS name and share name
Amazon FSx for Lustre is a scalable, high-performance file system designed specifically for compute-intensive
workloads such as machine learning, high-performance computing (HPC), and analytics. It leverages the
Lustre file system, providing sub-millisecond latency and throughput up to hundreds of gigabytes per
second. FSx for Lustre is fully managed, simplifying setup, maintenance, and scaling, while offering seamless
integration with AWS services.
Only SSDs
SCRATCH
High and
Scalable
SSD or HDD
Performance
PERSISTENT
01 02
Balance
Parallelize your
Workloads with
Workloads
Striping
03 04
- Make a directory on FSx for Lustre for the mount point (`sudo mkdir -p /fsx`).
- Mount the FSx file system to the directory (`sudo mount -t lustre -o relatime,flock
123.456.789.0@tcp:/fsx /fsx`).