0% found this document useful (0 votes)
8 views

EC2-and-File-Systems.pptx

This ppt for guide ec2 and file system

Uploaded by

Krrishna Chauhan
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PDF, TXT or read online on Scribd
0% found this document useful (0 votes)
8 views

EC2-and-File-Systems.pptx

This ppt for guide ec2 and file system

Uploaded by

Krrishna Chauhan
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PDF, TXT or read online on Scribd
You are on page 1/ 78

AWS Certified

Solutions Architect
Associate C03
Module 2

Elastic Compute
Cloud and File
Systems
1. Global Infrastructure

Agenda 2.

3.
Amazon EC2

Amazon Elastic Block Store (EBS)

4. Amazon Elastic File Systems (EFS)

5. Amazon FSx

© Copyright Intellipaat. All rights reserved.


Global
Infrastructure

© Copyright Intellipaat. All rights reserved.


Global Infrastructure

The Amazon Web Services (AWS) infrastructure is organized into regions and availability zones, which are
fundamental concepts for designing fault-tolerant and highly available applications and providing global
reach.

AWS Region

Availability Zone 1 Availability Zone 2

Availability Zone 3

© Copyright Intellipaat. All rights reserved.


Regions

● An AWS region is a separate geographical area where


AWS deploys and manages its infrastructure.

● Each region ensures proximity for users and isolation for


reliability and faster access to applications.

● Examples of AWS regions include us-east-1 (North


Virginia), eu-west-1 (Ireland), ap-southeast-2 (Sydney),
etc.

© Copyright Intellipaat. All rights reserved.


Availability Zones

● AWS availability zones offer low-latency, high-throughput


connections for consistent and reliable performance across
services.

● Each availability zone is designed to be independent of


other AZs to prevent simultaneous failures.

● Typically, AWS regions consist of at least two availability


zones, although some regions may have more.

© Copyright Intellipaat. All rights reserved.


Amazon Elastic
Compute Cloud

© Copyright Intellipaat. All rights reserved.


Introduction to EC2

Amazon Elastic Compute Cloud (EC2) is a cloud computing service provided by AWS that offers resizable
compute capacity in the cloud. It allows users to launch and manage virtual servers, called instances, on the
AWS infrastructure.

© Copyright Intellipaat. All rights reserved.


What Is Elasticity?

Elasticity refers to the ability of a cloud computing system to dynamically adjust its capacity to handle
changing workloads. This means that resources such as compute, storage, and networking can be
automatically scaled up or down based on demand, allowing users to efficiently use resources and pay only for
what they consume.

Auto-Scaling Amazon S3

Elastic Services

Amazon RDS
Elastic Load Balancing

© Copyright Intellipaat. All rights reserved.


What Is Elasticity?

Without Elasticity With Elasticity

Increased Load Decreased Load

© Copyright Intellipaat. All rights reserved.


Components of EC2

1
Instances Instance Types

6
Virtual servers, hosted The different
in the cloud, can be configurations
customized to run available for users
different operating to launch and run
systems. their applications.

2
Amazon Machine Images Key Pairs

5
Pre-configured Key pairs are used
templates that for secure access
contain to EC2 instances.
configurations and
operating systems to

4 33
launch instances.
Elastic Block Store Load Balancing
EBS provides Distributes incoming
persistent block-level application traffic
storage volumes that across multiple EC2
can be attached to instances to improve
EC2 instances. availability.

© Copyright Intellipaat. All rights reserved.


Instance Types

Compute Memory
Optimized Optimized
Compute optimized Memory optimized
instances are designed instances are ideal for
for applications that applications that require
require a large amount of
high-performance memory.
processors.

Storage Accelerated
Optimized Computing
These instances are
Accelerated computing
designed for workloads
instances use hardware
that require high,
accelerators, or
sequential read and
co-processors, to perform
write access to very large
functions.
Instance Types data sets on local
storage.

© Copyright Intellipaat. All rights reserved.


Instance Purchasing Options

Instances available at Pay for a physical host


significantly reduced that is fully dedicated
prices, suitable for to running your
non-time-sensitive instances, and bring
and non-critical tasks. your existing per-VM
software licenses to
01 03 reduce costs.

Spot Instances Dedicated Instances


On-Demand Reserved Instances

Instances with flexible Instances offering


pricing and no upfront 02 discounted hourly 04
commitment. Pay, by rates with a
the second. commitment to a one-
or three-year term.

© Copyright Intellipaat. All rights reserved.


Placement Groups

Cluster Partition
Instances spread across partitions
Instances placed in close proximity
within one or more clusters for
within a single Availability Zone for
large-scale distributed and
low-latency communication
replicated workloads

Spread
Instances spread across
distinct underlying hardware
to minimize correlated
failures

© Copyright Intellipaat. All rights reserved.


Hands-On
Launch and Connect to Linux EC2 Instance

© Copyright Intellipaat. All rights reserved.


Hands-On Summary

● Log in to the AWS Management Console

● Navigate to the EC2 Dashboard

● Choose an Amazon Machine Image - Ubuntu

● Choose an Instance Type - t2.micro

● Configure Instance Details

● Configure Security Group - SSH Port 22

● Create a Key Pair

● Launch Instance

© Copyright Intellipaat. All rights reserved.


Hands-On
Launch and Connect to Windows EC2
Instance

© Copyright Intellipaat. All rights reserved.


Hands-On Summary

● Log in to the AWS Management Console

● Navigate to the EC2 Dashboard

● Choose an Amazon Machine Image (AMI) - Windows

● Choose an Instance Type - t2.micro

● Configure Instance Details

● Configure Security Group - RDP Port 3389

● Create a Key Pair

● Launch Instance

© Copyright Intellipaat. All rights reserved.


Elastic Block Store

© Copyright Intellipaat. All rights reserved.


What Is an Elastic Block Store?

The Amazon Elastic Block Store (EBS) provides persistent block-level storage volumes for use with Amazon
EC2 instances. It offers reliable, low-latency storage that can be easily attached to and detached from EC2
instances. EBS volumes support various performance options and features, including snapshots for backups
and encryption for security.

© Copyright Intellipaat. All rights reserved.


EBS Concepts

S
EB

An EBS volume is
automatically Throughput
replicated.

It is the raw IOPS


unformatted
block-level storage.

© Copyright Intellipaat. All rights reserved.


EBS Volume Types

Volume Types

GP2: General-purpose IO1: Provisioned ST1: Throughput- SC1: Cold Storage


SSD SSD optimized HDD

© Copyright Intellipaat. All rights reserved.


Hands-On
Creating, Attaching and Managing EBS
Volumes

© Copyright Intellipaat. All rights reserved.


Hands-On Summary

Creating and Attaching EBS Volumes:

● Open the Amazon EC2 console and navigate to Volumes.

● Choose Create volume, specify volume type, size, and

availability zone.

● Choose Create volume.

● Once created, select the volume and choose Actions ->

Attach volume.

● Select the instance to attach the volume to and choose

Attach volume.

© Copyright Intellipaat. All rights reserved.


Hands-On Summary

Mounting Volumes :

For Linux

● Use lsblk to list available block devices and identify the attached volume.

● Create a mount point directory with mkdir -p <directory-name>

● Create a filesystem on the attached volume with mkfs.

● Mount the EBS volume to the mount point with a mount.

For Windows

● Connect to the instance and open Disk Management (diskmgmt.msc)

● Bring the new disk online and initialize it with MBR.

● Create a new simple volume in the unallocated space.

© Copyright Intellipaat. All rights reserved.


EBS Multi-Attach
Elastic Block Store (EBS) Multi-Attach is a feature provided by Amazon Web Services that allows you to attach a
single EBS volume to multiple EC2 instances within the same Availability Zone. This feature is particularly
useful in scenarios where you need shared access to a storage volume across multiple instances, such as for
distributed file systems, clustered databases, or shared application data.

© Copyright Intellipaat. All rights reserved.


EBS Multi-Attach

Without Multi-Attach With Multi-Attach

EBS 1 Instance 1
Instance 1

EBS

EBS 2 Instance 2
Instance 2

© Copyright Intellipaat. All rights reserved.


EBS Snapshots
Elastic Block Store (EBS) snapshots are a crucial feature of Amazon Web Services (AWS) that enable the backup
and restoration of EBS volumes.

Point-in-Time Recovery

Backup Solution

Volume Cloning

Incremental Backups

Encryption

© Copyright Intellipaat. All rights reserved.


Hands-On
Create Amazon EBS Snapshots

© Copyright Intellipaat. All rights reserved.


Hands-On Summary

Create Amazon EBS Snapshots:

- Open the Amazon EC2 console.

- In the navigation pane, choose `Snapshots` -> `Create snapshot`.

- For Resource type, choose `Volume`.

- Select the volume you wish to create a snapshot of for Volume ID.

- Click on `Create snapshot`.

© Copyright Intellipaat. All rights reserved.


Hands-On Summary

Restore Instance from a Snapshot:

- Select `Snapshots` from the left pane.

- Select `Actions`, then click `Create image from snapshot`.

- Provide an Image name and description.

- Select `Create Image`.

- Open the AMI section and select your AMI once created, click `Launch Instance from AMI`.

- On the Launch the instance page, provide a name for your instance.

- Under the AMI section, your image will be selected by default.

- Finally, launch the instance by referring to the steps in Hands-On 1: Launch and Connect to

the EC2 instance.

© Copyright Intellipaat. All rights reserved.


What Is an Amazon Machine Image?

An Amazon Machine Image – AMI provides the information required to launch an instance, which is a virtual
server in the cloud. An AMI is basically a template and can be used to launch as many instances as needed.
Within a VPC, instances can be launched from as many different AMIs

AMI Consists of the following:

One or More EBS Snapshots,

Launch Permissions

A Block Device

© Copyright Intellipaat. All rights reserved.


AMI Lifecycle

The lifecycle of an Amazon Machine Image (AMI) in AWS involves several stages, from creation to eventual
deprecation. Here's an overview of the typical AMI lifecycle:

Launch

Instance
Create Register

EBS Snapshot AMI #1

Copy

AMI #2
Deregister

© Copyright Intellipaat. All rights reserved.


Hands-On
Create and Manage AMIs

© Copyright Intellipaat. All rights reserved.


Hands-On Summary

Create and Manage AMIs:

- Sign in to the AWS Management Console and open the Amazon EC2 console.

- Launch an EC2 instance with the desired settings.

- Install Apache2 on the instance.

- Create an AMI from the instance.

- Verify the AMI in the console.

- Launch a new instance using the AMI.

- Verify the Apache service on the new instance.

Clean Up Your AMI:

- Deregister the AMI from the console.

© Copyright Intellipaat. All rights reserved.


Elastic File System

© Copyright Intellipaat. All rights reserved.


Amazon Elastic File System

AWS EFS (Elastic File System) is a scalable, fully managed file storage service for EC2 instances, supporting
NFSv4 protocols. It provides elastic capacity and performance, allowing multiple instances to access shared file
data simultaneously. With automatic scaling and high availability, EFS simplifies file storage for applications
and workloads requiring shared access.

© Copyright Intellipaat. All rights reserved.


What Is a File System?

A file system is a method used by operating systems and software to organize and store data on storage
devices such as hard drives, solid-state drives (SSDs), or network storage. It provides a structured way to store,
retrieve, and manage files and directories.

© Copyright Intellipaat. All rights reserved.


What Is a Mount Target?

A mount target is a network endpoint that allows Amazon EC2 instances or on-premises servers to connect to
an EFS file system. Mount targets are used to facilitate the mounting of an EFS file system on EC2 instances or
servers, enabling them to access and interact with the shared file system.

© Copyright Intellipaat. All rights reserved.


EFS Deployment Options

Elastic File System (EFS) allows you to choose between two deployment options: Regional and One Zone. Each
option has its own advantages and considerations, depending on your specific requirements and use case.

Regional
One Zone

● Better Availability
● Cost-effective
● Designed for Durability
● Deployed within single AZ
● High throughput and low
● low latency within same AZ
latency access

© Copyright Intellipaat. All rights reserved.


Features of EFS

Scalability

Shared File Storage

Fully Managed

High Availability

Encryption

© Copyright Intellipaat. All rights reserved.


EBS vs. EFS

Elastic File
01 It is used by database System
applications those who
depends upon random reads
and random reply. 01 Performance varies
based on the selected
performance mode
It is primarily used for data
02
that must be quickly
accessible while also being
long- Automatically scales to
02
lasting. accommodate growing
storage needs
03 Ideal for block-level
storage attached to
individual EC2 instances
03 Suitable for shared file
storage accessible by
Elastic Block multiple EC2
Store

© Copyright Intellipaat. All rights reserved.


Use Cases of EFS

Development Testing
Environments Environments

Content
Big Data
Repositories

© Copyright Intellipaat. All rights reserved.


Disadvantages to Using an EFS

No Windows No System Boot


Instances Volumes

Amazon EFSs are Amazon EFS volumes


not supported on also cannot be used
AWS Windows EC2 for system boot
instances volumes.

© Copyright Intellipaat. All rights reserved.


EFS Diagram

Availability Zone A Availability Zone B

Instance Instance

Mount Target Mount Target

EFS File Share

© Copyright Intellipaat. All rights reserved.


Hands-On
Create your Amazon EFS and Mount to EC2
Instances

© Copyright Intellipaat. All rights reserved.


Hands-On Summary

Create an Amazon EFS File System:

- Sign in to the AWS Management Console and open the Amazon EFS console.

- Choose "Create file system" to open the dialog box.

- Enter a name for your file system.

- For Virtual Private Cloud (VPC), choose your VPC.

- Choose "Create."

© Copyright Intellipaat. All rights reserved.


Hands-On Summary

Mount the Amazon EFS File System on an EC2 Linux Instance:

- Open a terminal window on your EC2 instance through Secure Shell (SSH) or EC2 instance

connect.

- Create a directory that you will use as the file system mount point (e.g., `sudo mkdir efs`).

- Open the EFS file system created and choose "Attach."

- Run the following commands to mount your file system. Navigate to "Mount via DNS" -> "Using

the EFS mount helper":

`$ sudo mount -t efs -o tls fs-0dd2b009c7d8f6ec2:/ efs`

© Copyright Intellipaat. All rights reserved.


Amazon FSx

© Copyright Intellipaat. All rights reserved.


What Is Amazon FSx?

Amazon FSx is a fully managed file storage service that provides high-performance file systems compatible
with Windows and Lustre for compute-intensive workloads. It offers features like automatic backups, data
deduplication, and integration with AWS services, simplifying file storage management for applications
requiring shared access and low-latency performance.

© Copyright Intellipaat. All rights reserved.


Use Cases of FSx

High-Performance
Windows File Sharing
Computing

Database Backups Software Development

Big Data Analytics Content Delivery

© Copyright Intellipaat. All rights reserved.


Features of FSx

Simple and
Fully
Managed 1

2 Fast Delivery

Highly
available
3

Secure and
4 Compliant

Easy
Integration 5

© Copyright Intellipaat. All rights reserved.


Types of Amazon FSx Filesystems

Amazon FSx lets you choose between four widely-used file systems:

© Copyright Intellipaat. All rights reserved.


Amazon FSx for NetApp ONTAP

Amazon FSx for NetApp ONTAP delivers fully managed, highly available, and scalable file storage with
enterprise-grade features. It provides familiar data management capabilities, such as snapshots, cloning, and
replication, enabling seamless integration with existing NetApp ONTAP ecosystems while offering the
elasticity and cost-effectiveness of the AWS cloud.

© Copyright Intellipaat. All rights reserved.


Amazon FSx for OpenZFS

Amazon FSx for OpenZFS is a fully managed file storage service that makes it easy to move data residing in
on-premises ZFS or other Linux-based file servers to AWS without changing your application code or how you
manage data.

© Copyright Intellipaat. All rights reserved.


Amazon FSx for Windows File Server

Amazon FSx for Windows File Server provides fully managed Microsoft Windows file servers. Amazon FSx
has native support for Windows file system features and for the industry-standard Server Message Block
(SMB) protocol to access file storage over a network, with native Windows compatibility, and consistent
sub-millisecond latencies.

© Copyright Intellipaat. All rights reserved.


Amazon FSx for Windows Supported Clients

Amazon EC2 Instances

WorkSpaces
Instances

Amazon ECS Containers

VMware Cloud on
AWS Environments

AppStream 2.0
Instances

© Copyright Intellipaat. All rights reserved.


Features of Amazon FSx for Windows

A Fully Managed Service

B Integration with Active Directory

C SMB Protocol Support

© Copyright Intellipaat. All rights reserved.


How FSx Provides Best Solution

Compatibility Performance Readiness

100% compatible with Performance your applications Enterprise ready:


Windows applications need: ● Highly Available
● Sub-millisecond latencies ● Highly Durable
● High throughput and IOPS ● Secure
● Flexibility based on workloads ● Compliant
needs

© Copyright Intellipaat. All rights reserved.


Native Windows Compatibility and Features

NTFS Native SMB


2.0 and 3.1.1

Native Windows
Compatibility DFS Namespace Integrates with
DFS Replication Microsoft AD

© Copyright Intellipaat. All rights reserved.


Fast and Flexible Performance

Built on SSD
High Throughput
Storage

High IOPS

Fast and Flexible


Performance DFS Namespace Integrates with
DFS Replication Microsoft AD

© Copyright Intellipaat. All rights reserved.


Highly Available and Durable

Continuously Backups are Stored


Monitor for Failures in Amazon S3

Highly Available and


Durable
Data Replication in Multiple Supports Multi-AZ
AZs Deployments

© Copyright Intellipaat. All rights reserved.


Working of FSx for Windows File Server

© Copyright Intellipaat. All rights reserved.


Hands-On
Create an AWS Managed Microsoft AD
Directory

© Copyright Intellipaat. All rights reserved.


Hands-On Summary

Create AWS Managed Microsoft AD Directory:

- In AWS Directory Service console, choose `Directories`.

- Choose `Set up directory`.

- Select `AWS Managed Microsoft AD` and click `Next`.

- Choose `Standard Edition`.

- Provide a DNS name and Admin password, click `Next`.

- Select your VPC, click `Next`.

- Choose `Create directory`.

© Copyright Intellipaat. All rights reserved.


Hands-On
Amazon FSx for Windows

© Copyright Intellipaat. All rights reserved.


Hands-On Summary

Create Amazon FSx for Windows File System:

● Open Amazon FSx console.

● Click Create file system.

● Choose Amazon FSx for Windows File Server and click Next.

● Select Quick create for Creation method.

● Provide a name for the file system.

● Choose Multi-AZ for Deployment type and specify minimum storage capacity (32 GiB).

● In the Network & security section, select your VPC and VPC Security Groups.

● Click Next.

© Copyright Intellipaat. All rights reserved.


Hands-On Summary

Mount FSx on Windows Instance:

● Choose AWS Managed Microsoft Active Directory, select directory, click Next.

● Review and click Create file system.

● Connect to Windows instance using RDP.

● Open Internet Protocol Version 4 settings and change DNS server addresses.

● Change computer name to AWS Directory Service directory.

● Open File Explorer, right-click Network, click Map Network Drive.

● Select drive letter, provide file system DNS name and share name

© Copyright Intellipaat. All rights reserved.


Amazon FSx for Lustre

Amazon FSx for Lustre is a scalable, high-performance file system designed specifically for compute-intensive
workloads such as machine learning, high-performance computing (HPC), and analytics. It leverages the
Lustre file system, providing sub-millisecond latency and throughput up to hundreds of gigabytes per
second. FSx for Lustre is fully managed, simplifying setup, maintenance, and scaling, while offering seamless
integration with AWS services.

© Copyright Intellipaat. All rights reserved.


Working of FSx for Lustre

© Copyright Intellipaat. All rights reserved.


FSx for Lustre High Performance

Only SSDs

SCRATCH

High and
Scalable
SSD or HDD

Performance

PERSISTENT

© Copyright Intellipaat. All rights reserved.


Best Practices to Optimize Performance

01 02

Balance
Parallelize your
Workloads with
Workloads
Striping

03 04

Average I/O Size Client Selection

© Copyright Intellipaat. All rights reserved.


FSx for Lustre Architecture

© Copyright Intellipaat. All rights reserved.


FSx Multi AZ Architecture

© Copyright Intellipaat. All rights reserved.


Hands-On
Amazon FSx for Lustre

© Copyright Intellipaat. All rights reserved.


Hands-On Summary

Create Amazon FSx for Lustre File System:

- Open Amazon FSx console and click `Create file system`.

- Choose `FSx for Lustre` and click `Next`.

- Choose `Scratch SSD` for Deployment and storage type.

- Provide Storage capacity as `1.2 TiB`.

- Select VPC and Security Groups, click `Next`.

- Review and click `Create file system`.

Mount FSx for Lustre File System:

- Make a directory on FSx for Lustre for the mount point (`sudo mkdir -p /fsx`).

- Mount the FSx file system to the directory (`sudo mount -t lustre -o relatime,flock

123.456.789.0@tcp:/fsx /fsx`).

© Copyright Intellipaat. All rights reserved.


Contact Us
080-4524-9465

[email protected]

© Copyright Intellipaat. All rights reserved.

You might also like