0% found this document useful (0 votes)
67 views35 pages

Azure Arc Data Services Architecture

Uploaded by

ethan yang
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PDF, TXT or read online on Scribd
0% found this document useful (0 votes)
67 views35 pages

Azure Arc Data Services Architecture

Uploaded by

ethan yang
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PDF, TXT or read online on Scribd
You are on page 1/ 35

Azure Arc-enabled

data services
Cloud PaaS experience for
data workloads anywhere
Azure Arc extends the Azure Control
Plane and brings Azure services to
any infrastructure.
Azure Arc

Azure Arc-enabled infrastructure Azure Arc-enabled services


Connect and operate hybrid resources Deploy and run Azure services outside of Azure
as native Azure resources while still operating it from Azure

Multi-cloud Datacenter Edge


Azure Arc-enabled infrastructure
Bring on-premises and multi-cloud infrastructure to Azure with Azure Arc

SQL Server on Azure Arc-


Azure Arc-enabled servers Azure Arc-enabled Kubernetes
enabled servers
Organize, inventory, and monitor Organize, inventory, and monitor Organize, inventory, and monitor
Governance and Security Governance and Security Governance and Security
Simplified role-based operations Use with your existing SQL servers Monitoring and Policy
Physical, Virtual, Windows, Linux SQL on Windows or Linux servers GitOps-based zero-touch deploy

AKS on Azure
Stack HCI
OpenShift
AWS Linux 2

Now available Now available Now available


Azure Arc-enabled application services PREVIEW

Run your apps, anywhere

App Functions Logic API Event Grid


Service Apps Management

Cloud-native, at scale Flexibility Unified Management


Manage applications running on Use the services you want with any
Kubernetes at scale with modern CNCF-conformant Kubernetes cluster
cloud native practices
Azure Arc-enabled machine learning PREVIEW

Build models on-premises, in multi-cloud, and at the edge with Azure Arc

Innovate rapidly Operate efficiently Unified Management


Use familiar tools Get started in minutes
Meet regulatory compliance No data movement
Auto scale compute anywhere Leverage existing infrastructure
Azure Arc enabled data services
Cloud experience for data workloads anywhere

AVAILABLE NOW PUBLIC PREVIEW

Support disconnected mode

Always As-a-Service Elastic scale Unified Cloud Billing


current management Model
Azure SQL and PostgreSQL enabled by Azure Arc
IaaS PaaS

SQL Server on Azure Azure SQL Managed Azure PostgreSQL


virtual machines Instance Hyperscale

Azure Arc

SQL Server on Azure Arc- Azure Arc-enabled SQL Azure Arc-enabled


enabled servers Managed Instance PostgreSQL Hyperscale

Azure SQL enabled by Azure Arc


Azure Arc enabled data services Architecture
Microsoft Container
Data/Azure Admin
Registry

Azure Arc Integration Azure Portal

Customer Hosted Identity Resource Inventory


Registry Azure RBAC & Policy Logs & Telemetry Azure CLI
Azure Data Studio
Advanced Data Security Backup Retention
Azure Arc Extension Deployments & Config Consumption
Direct Connect Mode

azdata CLI

Indirect
Connect Azure Arc Data Controller PostgreSQL Hyperscale Azure SQL Managed Instance Future Future
Mode data services Analytics Engines
API Azure Arc Integration
Monitoring & logs Patching & Updates
Backup Scaling fluentbit collectd fluentbit collectd
HA/DR Provisioning

Any Kubernetes Cluster


Kubernetes
API

AKS AKS on Azure Stack HCI OpenShift EKS GKE VMware Tanzu kubeadm

Any Infrastructure
Azure Arc-enabled data services: management comparison
Deployment Model
Built-in Capabilities Customer Infrastructure Azure
SQL Server / PostgreSQL Azure Arc enabled-data services Azure PaaS services
Database security features

Limited by the capacity of customer


Elastic / “Limitless” scalability
infrastructure
Customer responsible for
Automatic HA/DR
underlying HW/K8s availability

Auto upgrade, patching

Auto backup-restore

Monitoring

Customer responsible Customer responsible for


Compliance certifications 90+ certifications
for compliance certification compliance certification
Azure regions not available
Data sovereignty
in all countries yet
Pre-defined HW options
Customer control
No control over HW/OS
Customer-managed using software
Fully managed by Microsoft Customer-managed
provided by Microsoft
Customer-managed using software
Guaranteed availability SLA Customer-managed
provided by Microsoft
Connectivity Modes
Built-in capabilities
Indirectly Connected Directly Connected

Automatic HA/DR

Self-service provisioning

Elastic / “Limitless” scalability

Billing

Auto upgrade, patching


Azure Backup (future)
Auto backup-restore
Azure
Monitoring Monitor. +Container Insights

Authentication

Role Based Access Control (RBAC)

Inventory in Azure

User experiences/tools
+Advanced Threat Protection (Future)
Security services +Vulnerability Assessment (Future)

Items in blue text are optional, add-on Azure services with their
own pricing model.
Technical Deep-dive

© Copyright Microsoft Corporation. All rights reserved.


Security in Kubernetes
Azure Arc-enabled Data Services Security (1 of 2)

Azure Active
Directory

Azure Control Plane

• Azure CLI
Azure Data Studio Browser
Kubernetes tools

HTTPS HTTPS HTTPS



Kubernetes Azure Arc Metrics & Logs
API Data Controller Dashboards

Any Kubernetes Cluster


Azure Arc-enabled Data Services Security (2 of 2)

Azure Data Studio, Azure Data Studio,


• Tools & Tools &
Apps/Drivers Apps/Drivers
• Active directory

• TCP with SSL


TCP with
SSL/TLS


Azure PostgreSQL Azure SQL
• Hyperscale Managed Instance

Azure Arc-enabled Data Services


Always current / “evergreen” with
automated updates
Arc Data Services Maintenance updates



K8s Worker Node

• Data Controller

K8s Worker Node K8s Worker Node K8s Worker Node

Pod Pod Pod

Availability SQL MI SQL MI SQL MI


Group Secondary
Primary Secondary
Primary Secondary

State:
State:
State:Unpatched
Patching
Patched State:
State:
State:Unpatched
Patching
Patched State:
State:Unpatched
Unpatched
Patching
Back up & restore
Point-In-Time Restore [PITR]
Simple enablement of Point in Time Restore


• Azure Data Studio




Kubernetes Node Node Node


Persistent Storage
Elastic scale
Scaling: Azure Arc-enabled PostgreSQL Hyperscale
Worker nodes

W1


Server group
Application
W2


Coordinator
node
W3 … Wn

Scaling: Azure Arc-enable SQL Managed Instance
Scale the same instance to match demand


Az CLI command Azure Data Studio



4 GB

Scale up
• 64 GB

Scale down
4 GB

Available space Used Cores/Memory
High availability
High availability for Arc-enabled SQL
Primary
Health checks

PostgreSQL Application
Streaming
replication
Monitor

SQL (fallback) Health checks


Secondary

W1
Worker 1
Primary

W1 Worker 1
Secondary

COORDINATOR
Primary

Server group
W1
Worker 2
Primary
Application
W1 Worker 2
Secondary

W1
COORDINATOR Worker n
Secondary Primary

W1 Worker n
Monitor Secondary
Azure Arc enabled SQL Managed
Instance High Availability

Resources
https://docs.microsoft.com/en-us/azure/azure-arc/data/managed-instance-high-availability
Preview
Azure Arc enabled data services (1 of 5) K8s Worker Node

SQL Managed Instance High Availability Data


Controller

Built-in Setup
K8s Worker Node K8s Worker Node K8s Worker Node
No other cluster technologies
Default configuration with Pod Pod Pod

3 sync replicas
Availability SQL MI SQL MI SQL MI
Primary and readable secondary Group Primary Secondary Secondary
endpoints
Automated Failover AG agent AG agent AG agent

Load Balancer

Service

Web App
Preview
Azure Arc enabled data services (2 of 5) K8s Worker Node

SQL Managed Instance High Availability Data


Controller

Built-in Setup
K8s Worker Node K8s Worker Node K8s Worker Node
No other cluster technologies
Default configuration with Pod Pod Pod

3 sync replicas
Availability SQL MI SQL MI SQL MI
Primary and readable secondary Group Primary Secondary Secondary
endpoints
Automated Failover AG agent AG agent AG agent

Load Balancer

Service Service

Read-Only

Web App Web App


Preview
Azure Arc enabled data services (3 of 5) K8s Worker Node

SQL Managed Instance High Availability Data


Controller

Built-in Setup
K8s Worker Node K8s Worker Node K8s Worker Node
No other cluster technologies
Default configuration with Pod Pod Pod

3 sync replicas
Availability SQL MI SQL MI SQL MI
Primary and readable secondary Group Primary Secondary Secondary
endpoints
Automated Failover AG agent AG agent AG agent

Load Balancer

Service Service

Read-Only

Web App Web App


Preview
Azure Arc enabled data services (4 of 5) K8s Worker Node

SQL Managed Instance High Availability Data


Controller

Built-in Setup
K8s Worker Node K8s Worker Node K8s Worker Node
No other cluster technologies
Default configuration with Pod Pod Pod

3 sync replicas
Availability SQL MI SQL MI SQL MI
Primary and readable secondary Group Primary Primary Secondary
endpoints
Automated Failover AG agent AG agent AG agent

Load Balancer

Service Service

Read-Only

Web App Web App


Preview
Azure Arc enabled data services (5 of 5) K8s Worker Node

SQL Managed Instance High Availability Data


Controller

K8s Worker Node K8s Worker Node K8s Worker Node

Pod Pod Pod

Availability SQL MI SQL MI SQL MI


Group Secondary Primary Secondary

AG agent AG agent AG agent

Load Balancer

Service Service

Read-Only

Web App Web App


Preview
Arc enabled Azure SQL Managed Instance
High Availability and Disaster Recovery using Availability Groups
K8s Worker Node K8s Worker Node

Data Data
Controller Controller

K8s Worker Node K8s Worker Node K8s Worker Node K8s Worker Node K8s Worker Node K8s Worker Node
Distributed
Availability
Group Pod Pod Pod Pod Pod Pod

Availability SQL MI SQL MI SQL MI Availability SQL MI SQL MI SQL MI


Group Primary Secondary Secondary Group Primary Secondary Secondary

AG agent AG agent AG agent AG agent AG agent AG agent

Read-Write Read-Only Read-Write Read-Only

Load Balancer Load Balancer

R/W K8s Service R/O K8s Service R/W K8s Service R/O K8s Service

Disaster Recovery (DR)


Multiple K8s clusters
App App App App
Primary connections DR connections
DNS routing

High Availability (HA) High Availability (HA)


Single K8s cluster – multiple nodes in Datacenter 1 (Primary Site) Application clients Single K8s cluster – multiple nodes in Datacenter 2 (DR Site)
Azure Arc
Azure AD Backup Monitor Security Center Policy Cloud Shell Resource Log Analytics Automation Advisor
Groups

Azure Arc

SQL MI & SQL MI & SQL MI & SQL MI &


Postgres HS Postgres HS Postgres HS Postgres HS

Any Kubernetes Any SQL Any SQL Any SQL


Any server SQL Server AKS on HCI AKS EKS, GKE, ...
(e.g. OpenShift) server Server server Server server Server

Azure Stack HCI Azure VM service EC2, GCE, ...

Any infrastructure Azure Stack Hub/Edge AWS, GCP, … infrastructure

Full stack supported by Microsoft on your Full stack provided/supported by


choice of certified hardware Microsoft and OEM partners
Fabrikam Azure Tenant

Virtual Machines Storage Network App Services

Kubernetes Data Cosmos DB Functions


Service Services

Azure Arc enabled infrastructure & services

Azure Arc

Azure Arc Azure Arc Azure Arc


Azure Arc Azure Arc Azure Arc
Bare-Metal Windows & Linux Kubernetes SQL Server SQL Managed PostgreSQL
SQL Server SQL Managed PostgreSQL
Servers Servers Bare-Metal / VM Instance Hyperscale
Instance Hyperscale
AWS Elastic GCP Google
EC2 Kubernetes Instance Kubernetes
Azure Arc Data Controller Service (EKS) Engine (GKE) Azure Arc Data Controller

Fabrikam On-Premises Datacenter Fabrikam Multi-Cloud Workloads


Demo
Thank you

© Copyright Microsoft Corporation. All rights reserved.

You might also like