SlideShare a Scribd company logo
January 2019
Automation & Management of
PostgreSQL with ClusterControl
Sebastian Insausti
Presenter
sebastian@severalnines.com
Copyright 2018 Severalnines AB
I'm Jean-Jérôme from the Severalnines Team and
I'm your host for today's webinar!
Feel free to ask any questions in the Questions
section of this application or via the Chat box.
You can also contact me directly via the chat box
or via email: info@severalnines.com during or
after the webinar.
Your host & some logistics
Webinar slides: How to Automate & Manage PostgreSQL with ClusterControl
Copyright 2018 Severalnines AB
Copyright 2018 Severalnines AB
Free to download
Initial 30 days Enterprise trial
Converts into free Community Edition
Enterprise / paid versions available
Copyright 2018 Severalnines AB
Automation & Management
Deployment (Free Community)
● Deploy a Cluster in Minutes
○ On-Prem
○ Cloud (AWS/Azure/Google) - paid
Monitoring (Free Community)
● Systems View with 1 sec Resolution
● DB / OS stats & Performance Advisors
● Configurable Dashboards
● Query Analyzer
● Agentless & agent-based
Management (Paid Features)
● Backup Management
● Upgrades & Patching
● Security & Compliance
● Operational Reports
● Automatic Recovery & Repair
● Performance Management
● Automatic Performance Advisors
Copyright 2018 Severalnines AB
Supported Databases
Copyright 2018 Severalnines AB
Our Customers
Poll - multiple choice
Copyright 2018 Severalnines AB
Which method do you use to perform your DBA tasks?
● Manual actions
● Custom scripts
● External tools and utilities
● ClusterControl
● Others (please specify in the chat box)
January 2019
Automation & Management of
PostgreSQL with ClusterControl
Sebastian Insausti
Presenter
sebastian@severalnines.com
Copyright 2018 Severalnines ABCopyright 2018 Severalnines AB
Managing PostgreSQL
● Requirements for managing production
databases
“The Old Way”
● Labour intensive, manual operations
● Scripts, tools and utilities
● What happens when the DBA leaves?
Agenda
Automation and Management with ClusterControl
● Deployment
● Monitoring & Alerting
● Performance Management
● Backup management
● High Availability setups
● Single VIP endpoint with Load Balancer
● Automatic Failover
Live Demo
Copyright 2018 Severalnines AB
Copyright 2018 Severalnines AB
Requirements for managing production
databases
Copyright 2018 Severalnines ABCopyright 2018 Severalnines AB
Deployment
● Install
○ The first step to begin the game
● Secure
○ Keep your data safe and secure
● Configure
○ Environment requirements
Copyright 2018 Severalnines ABCopyright 2018 Severalnines AB
Monitoring & Alerting
● Define metrics
○ Database
○ Operating System
● Configure monitoring
○ Custom Monitoring
○ System Monitoring
● Configure alerts
○ Email alerts
○ Tool Integrations
Copyright 2018 Severalnines ABCopyright 2018 Severalnines AB
● Important but complex task
● PostgreSQL is configured with compatibility and stability by default
● Depends on the hardware and on the system itself
● Performance queries
Performance Management
Copyright 2018 Severalnines ABCopyright 2018 Severalnines AB
● Backups Methods:
○ Logical backup: Plain text files with SQL statements
○ Physical backup: A copy of the datafiles
● Backup tasks:
○ Schedule
○ Rotation / Retention
○ Secure Backup
○ Verify Backup
○ Point-in-time recovery backup
○ Upload to external datacenter, e.g., cloud storage
○ Reporting
Backup Management
Copyright 2018 Severalnines ABCopyright 2018 Severalnines AB
● Define topology
○ Master-Slave
○ Master-Master
● Define replication type
○ Synchronous: There is no loss of data even if our master node is lost. The commits
in the master must wait for a confirmation from the slave.
○ Asynchronous: There is a possibility of data loss in case we lose our master node. If
the replica is not updated at the time of the incident, the information that has not
been copied may be lost.
○ Logical Replication: Performed via SQL statements.
○ Physical Replication: Performed via internal data structure.
● Failover
● Single endpoint for application
High Availability setups
Poll - multiple choice
Copyright 2018 Severalnines AB
According to you, what are your most challenging tasks in production?
● A well tuned and secure configuration
● Monitoring uptime & Alerting
● Managing performance / queries
● Backup management
● Failover & High Availability
Copyright 2018 Severalnines AB
Copyright 2018 Severalnines AB
"The Old Way"
Copyright 2018 Severalnines ABCopyright 2018 Severalnines AB
Deployment
● Installation:
○ Repositories or packages
○ Some packages dependencies could be required
● Secure installation:
○ Configuration files (pg_hba.conf or postgresql.conf)
○ Authentication
● Basic configuration:
○ For example: Listen address or wal_level
○ Require DBA or Sysadmin skills
Copyright 2018 Severalnines ABCopyright 2018 Severalnines AB
What to monitor
● Database
○ Queries
○ Sessions
○ Locks
○ IO
○ Replication
○ Backups
● System
○ CPU
○ Memory
○ Load Average
○ Network
Monitoring & Alerting
Copyright 2018 Severalnines ABCopyright 2018 Severalnines AB
Performance Management
● Time consuming task
● There is not a standard configuration for this task
● Check charts
○ e.g: max_connections
● Database commands
○ EXPLAIN: Check the query plan
○ VACUUM: For several maintenance tasks
● Parameters
○ shared_buffers: Amount of memory that the database uses for shared memory
○ work_mem: Amount of memory used by internal operations like ORDER BY, DISTINCT, JOIN,
among others
● Require deep DBA knowledge
Copyright 2018 Severalnines ABCopyright 2018 Severalnines AB
Backup Management
● Typically done using custom scripts
● Some just copy the datafiles (!)
● Schedule using cron
● Manual rotation
● No backup verification or PITR backup
Copyright 2018 Severalnines ABCopyright 2018 Severalnines AB
● Master-Slave Topology
● Asynchronous replication
● Manual setup of slave
○ Install a new server
○ Copy data from master
○ Configure replication
High Availability Setups
Copyright 2018 Severalnines ABCopyright 2018 Severalnines AB
Automatic Failover
● We need to know when we need the failover
● PostgreSQL itself does not include an automatic failover mechanism
● After failover, the applications need to know about the new master
Copyright 2018 Severalnines ABCopyright 2018 Severalnines AB
● Load Balancer:
○ Balancing traffic
○ Redirect traffic to available nodes
○ Specify ports for different roles
○ It's an external component that requires installation,
configuration and monitoring
● Virtual IP:
○ Keepalived is a linux service that allows to configure a
virtual IP within an active/passive group of servers
○ Another external component that requires installation,
configuration and monitoring
Single VIP endpoint with Load Balancer
Copyright 2018 Severalnines ABCopyright 2018 Severalnines AB
● Where is the documentation?
● How do all these scripts hang together?
● It is often hard to know how the database is managed
● There is nobody to take over what you did
● It can be a mess
What happens when the DBA leaves?
Copyright 2018 Severalnines AB
Copyright 2018 Severalnines AB
ClusterControl - PostgreSQL automation
and management
Copyright 2018 Severalnines AB
ClusterControl
Copyright 2018 Severalnines ABCopyright 2018 Severalnines AB
Deployment
Copyright 2018 Severalnines ABCopyright 2018 Severalnines AB
Monitoring & Alerting
Copyright 2018 Severalnines ABCopyright 2018 Severalnines AB
Monitoring & Alerting
Copyright 2018 Severalnines ABCopyright 2018 Severalnines AB
Performance Management
Copyright 2018 Severalnines ABCopyright 2018 Severalnines AB
Backup Management
Copyright 2018 Severalnines ABCopyright 2018 Severalnines AB
High Availability Setups
Copyright 2018 Severalnines ABCopyright 2018 Severalnines AB
Single VIP endpoint with Load Balancer
Copyright 2018 Severalnines ABCopyright 2018 Severalnines AB
Automatic Failover
Copyright 2018 Severalnines ABCopyright 2018 Severalnines AB
ClusterControl CLI
$ s9s cluster --list --long
ID STATE TYPE OWNER GROUP NAME COMMENT
1 FAILURE galera system admins Galera1 Cluster failed to start.
2 STARTED postgresql_single system admins PostgreSQL1 All nodes are operational.
5 FAILURE replication system admins MySQL1 Cluster failed to start.
Total: 3
$ s9s node --list --cluster-id=2 --long
STAT VERSION CID CLUSTER HOST PORT COMMENT
coC- 1.7.1.2965 2 PostgreSQL1 192.168.100.110 9500 Up and running.
?o-- 2.3.2 2 PostgreSQL1 192.168.100.110 9090 Process 'prometheus' is running.
ho-- 1.5.18 2 PostgreSQL1 192.168.100.114 9600 Process 'haproxy' is running.
koM- 1.3 2 PostgreSQL1 192.168.100.114 112 Process 'keepalived' is running.
ho-- 1.5.18 2 PostgreSQL1 192.168.100.115 9600 Process 'haproxy' is running.
ko-- 1.3 2 PostgreSQL1 192.168.100.115 112 Process 'keepalived' is running.
poM- 10.5 2 PostgreSQL1 192.168.100.123 5432 Up and running.
poS- 10.5 2 PostgreSQL1 192.168.100.124 5432 Up and running.
poS- 10.5 2 PostgreSQL1 192.168.100.125 5432 Up and running.
Total: 9
Copyright 2018 Severalnines AB
Copyright 2018 Severalnines AB
Live Demo
● Deployment
● Add replication slave
● Add load balancer
● Deploy keepalived
● Monitoring
● Performance
● Backup
● Topology view
● CLI
Cluster Control PostgreSQL Management
Demo
Copyright 2018 Severalnines AB
Poll - multiple choice (choose one of below)
Copyright 2018 Severalnines AB
Where do you need the most improvements in your environment?
● Monitoring & Alerting
● Performance Management
● Backups
● High Availability & Automatic Failover
● Other (please specify in the chat box)
Copyright 2018 Severalnines AB
Copyright 2018 Severalnines AB
Q & A
Links & Resources
● ClusterControl for PostgreSQL
● Download / install ClusterControl
● ClusterControl Community Edition Page
● Contact us: info@severalnines.com

More Related Content

What's hot (20)

Webinar slides: Our Guide to MySQL & MariaDB Performance Tuning
Webinar slides: Our Guide to MySQL & MariaDB Performance TuningWebinar slides: Our Guide to MySQL & MariaDB Performance Tuning
Webinar slides: Our Guide to MySQL & MariaDB Performance Tuning
Severalnines
 
Performance Tuning Cheat Sheet for MongoDB
Performance Tuning Cheat Sheet for MongoDBPerformance Tuning Cheat Sheet for MongoDB
Performance Tuning Cheat Sheet for MongoDB
Severalnines
 
Webinar slides: An Introduction to Performance Monitoring for PostgreSQL
Webinar slides: An Introduction to Performance Monitoring for PostgreSQLWebinar slides: An Introduction to Performance Monitoring for PostgreSQL
Webinar slides: An Introduction to Performance Monitoring for PostgreSQL
Severalnines
 
Advanced MySql Data-at-Rest Encryption in Percona Server
Advanced MySql Data-at-Rest Encryption in Percona ServerAdvanced MySql Data-at-Rest Encryption in Percona Server
Advanced MySql Data-at-Rest Encryption in Percona Server
Severalnines
 
(slides) Polyglot persistence: utilizing open source databases as a Swiss poc...
(slides) Polyglot persistence: utilizing open source databases as a Swiss poc...(slides) Polyglot persistence: utilizing open source databases as a Swiss poc...
(slides) Polyglot persistence: utilizing open source databases as a Swiss poc...
Severalnines
 
How QBerg scaled to store data longer, query it faster
How QBerg scaled to store data longer, query it fasterHow QBerg scaled to store data longer, query it faster
How QBerg scaled to store data longer, query it faster
MariaDB plc
 
CCV: migrating our payment processing system to MariaDB
CCV: migrating our payment processing system to MariaDBCCV: migrating our payment processing system to MariaDB
CCV: migrating our payment processing system to MariaDB
MariaDB plc
 
How Pixid dropped Oracle and went hybrid with MariaDB
How Pixid dropped Oracle and went hybrid with MariaDBHow Pixid dropped Oracle and went hybrid with MariaDB
How Pixid dropped Oracle and went hybrid with MariaDB
MariaDB plc
 
How we switched to columnar at SpendHQ
How we switched to columnar at SpendHQHow we switched to columnar at SpendHQ
How we switched to columnar at SpendHQ
MariaDB plc
 
Introducing the ultimate MariaDB cloud, SkySQL
Introducing the ultimate MariaDB cloud, SkySQLIntroducing the ultimate MariaDB cloud, SkySQL
Introducing the ultimate MariaDB cloud, SkySQL
MariaDB plc
 
Introducing the R2DBC async Java connector
Introducing the R2DBC async Java connectorIntroducing the R2DBC async Java connector
Introducing the R2DBC async Java connector
MariaDB plc
 
Webinar slides: How to Measure Database Availability?
Webinar slides: How to Measure Database Availability?Webinar slides: How to Measure Database Availability?
Webinar slides: How to Measure Database Availability?
Severalnines
 
The architecture of SkySQL
The architecture of SkySQLThe architecture of SkySQL
The architecture of SkySQL
MariaDB plc
 
What to expect from MariaDB Platform X5, part 1
What to expect from MariaDB Platform X5, part 1What to expect from MariaDB Platform X5, part 1
What to expect from MariaDB Platform X5, part 1
MariaDB plc
 
Faster, better, stronger: The new InnoDB
Faster, better, stronger: The new InnoDBFaster, better, stronger: The new InnoDB
Faster, better, stronger: The new InnoDB
MariaDB plc
 
What to expect from MariaDB Platform X5, part 2
What to expect from MariaDB Platform X5, part 2What to expect from MariaDB Platform X5, part 2
What to expect from MariaDB Platform X5, part 2
MariaDB plc
 
MariaDB Enterprise Tools introduction
MariaDB Enterprise Tools introductionMariaDB Enterprise Tools introduction
MariaDB Enterprise Tools introduction
MariaDB plc
 
Under the hood: SkySQL monitoring
Under the hood: SkySQL monitoringUnder the hood: SkySQL monitoring
Under the hood: SkySQL monitoring
MariaDB plc
 
Getting started in the cloud for developers
Getting started in the cloud for developersGetting started in the cloud for developers
Getting started in the cloud for developers
MariaDB plc
 
Using Pentaho with MariaDB ColumnStore
Using Pentaho with MariaDB ColumnStoreUsing Pentaho with MariaDB ColumnStore
Using Pentaho with MariaDB ColumnStore
MariaDB plc
 
Webinar slides: Our Guide to MySQL & MariaDB Performance Tuning
Webinar slides: Our Guide to MySQL & MariaDB Performance TuningWebinar slides: Our Guide to MySQL & MariaDB Performance Tuning
Webinar slides: Our Guide to MySQL & MariaDB Performance Tuning
Severalnines
 
Performance Tuning Cheat Sheet for MongoDB
Performance Tuning Cheat Sheet for MongoDBPerformance Tuning Cheat Sheet for MongoDB
Performance Tuning Cheat Sheet for MongoDB
Severalnines
 
Webinar slides: An Introduction to Performance Monitoring for PostgreSQL
Webinar slides: An Introduction to Performance Monitoring for PostgreSQLWebinar slides: An Introduction to Performance Monitoring for PostgreSQL
Webinar slides: An Introduction to Performance Monitoring for PostgreSQL
Severalnines
 
Advanced MySql Data-at-Rest Encryption in Percona Server
Advanced MySql Data-at-Rest Encryption in Percona ServerAdvanced MySql Data-at-Rest Encryption in Percona Server
Advanced MySql Data-at-Rest Encryption in Percona Server
Severalnines
 
(slides) Polyglot persistence: utilizing open source databases as a Swiss poc...
(slides) Polyglot persistence: utilizing open source databases as a Swiss poc...(slides) Polyglot persistence: utilizing open source databases as a Swiss poc...
(slides) Polyglot persistence: utilizing open source databases as a Swiss poc...
Severalnines
 
How QBerg scaled to store data longer, query it faster
How QBerg scaled to store data longer, query it fasterHow QBerg scaled to store data longer, query it faster
How QBerg scaled to store data longer, query it faster
MariaDB plc
 
CCV: migrating our payment processing system to MariaDB
CCV: migrating our payment processing system to MariaDBCCV: migrating our payment processing system to MariaDB
CCV: migrating our payment processing system to MariaDB
MariaDB plc
 
How Pixid dropped Oracle and went hybrid with MariaDB
How Pixid dropped Oracle and went hybrid with MariaDBHow Pixid dropped Oracle and went hybrid with MariaDB
How Pixid dropped Oracle and went hybrid with MariaDB
MariaDB plc
 
How we switched to columnar at SpendHQ
How we switched to columnar at SpendHQHow we switched to columnar at SpendHQ
How we switched to columnar at SpendHQ
MariaDB plc
 
Introducing the ultimate MariaDB cloud, SkySQL
Introducing the ultimate MariaDB cloud, SkySQLIntroducing the ultimate MariaDB cloud, SkySQL
Introducing the ultimate MariaDB cloud, SkySQL
MariaDB plc
 
Introducing the R2DBC async Java connector
Introducing the R2DBC async Java connectorIntroducing the R2DBC async Java connector
Introducing the R2DBC async Java connector
MariaDB plc
 
Webinar slides: How to Measure Database Availability?
Webinar slides: How to Measure Database Availability?Webinar slides: How to Measure Database Availability?
Webinar slides: How to Measure Database Availability?
Severalnines
 
The architecture of SkySQL
The architecture of SkySQLThe architecture of SkySQL
The architecture of SkySQL
MariaDB plc
 
What to expect from MariaDB Platform X5, part 1
What to expect from MariaDB Platform X5, part 1What to expect from MariaDB Platform X5, part 1
What to expect from MariaDB Platform X5, part 1
MariaDB plc
 
Faster, better, stronger: The new InnoDB
Faster, better, stronger: The new InnoDBFaster, better, stronger: The new InnoDB
Faster, better, stronger: The new InnoDB
MariaDB plc
 
What to expect from MariaDB Platform X5, part 2
What to expect from MariaDB Platform X5, part 2What to expect from MariaDB Platform X5, part 2
What to expect from MariaDB Platform X5, part 2
MariaDB plc
 
MariaDB Enterprise Tools introduction
MariaDB Enterprise Tools introductionMariaDB Enterprise Tools introduction
MariaDB Enterprise Tools introduction
MariaDB plc
 
Under the hood: SkySQL monitoring
Under the hood: SkySQL monitoringUnder the hood: SkySQL monitoring
Under the hood: SkySQL monitoring
MariaDB plc
 
Getting started in the cloud for developers
Getting started in the cloud for developersGetting started in the cloud for developers
Getting started in the cloud for developers
MariaDB plc
 
Using Pentaho with MariaDB ColumnStore
Using Pentaho with MariaDB ColumnStoreUsing Pentaho with MariaDB ColumnStore
Using Pentaho with MariaDB ColumnStore
MariaDB plc
 

Similar to Webinar slides: How to Automate & Manage PostgreSQL with ClusterControl (20)

Webinar slides: Free Monitoring (on Steroids) for MySQL, MariaDB, PostgreSQL ...
Webinar slides: Free Monitoring (on Steroids) for MySQL, MariaDB, PostgreSQL ...Webinar slides: Free Monitoring (on Steroids) for MySQL, MariaDB, PostgreSQL ...
Webinar slides: Free Monitoring (on Steroids) for MySQL, MariaDB, PostgreSQL ...
Severalnines
 
Webinar slides: How to Achieve PCI Compliance for MySQL & MariaDB with Cluste...
Webinar slides: How to Achieve PCI Compliance for MySQL & MariaDB with Cluste...Webinar slides: How to Achieve PCI Compliance for MySQL & MariaDB with Cluste...
Webinar slides: How to Achieve PCI Compliance for MySQL & MariaDB with Cluste...
Severalnines
 
Pivotal Greenplum Cloud Marketplaces - Greenplum Summit 2019
Pivotal Greenplum Cloud Marketplaces - Greenplum Summit 2019Pivotal Greenplum Cloud Marketplaces - Greenplum Summit 2019
Pivotal Greenplum Cloud Marketplaces - Greenplum Summit 2019
VMware Tanzu
 
HKNOG 6.0 Next Generation Networks - will automation put us out of jobs?
HKNOG 6.0 Next Generation Networks - will automation put us out of jobs?HKNOG 6.0 Next Generation Networks - will automation put us out of jobs?
HKNOG 6.0 Next Generation Networks - will automation put us out of jobs?
Tom Paseka
 
Tips to drive maria db cluster performance for nextcloud
Tips to drive maria db cluster performance for nextcloudTips to drive maria db cluster performance for nextcloud
Tips to drive maria db cluster performance for nextcloud
Severalnines
 
Sprint 77
Sprint 77Sprint 77
Sprint 77
ManageIQ
 
Data Science in the Cloud @StitchFix
Data Science in the Cloud @StitchFixData Science in the Cloud @StitchFix
Data Science in the Cloud @StitchFix
C4Media
 
Webinar slides: How to automate and manage MongoDB & Percona Server for MongoDB
Webinar slides: How to automate and manage MongoDB & Percona Server for MongoDBWebinar slides: How to automate and manage MongoDB & Percona Server for MongoDB
Webinar slides: How to automate and manage MongoDB & Percona Server for MongoDB
Severalnines
 
Sprint 44 review
Sprint 44 reviewSprint 44 review
Sprint 44 review
ManageIQ
 
Sprint 59
Sprint 59Sprint 59
Sprint 59
ManageIQ
 
Advanced technologies and techniques for debugging HPC applications
Advanced technologies and techniques for debugging HPC applicationsAdvanced technologies and techniques for debugging HPC applications
Advanced technologies and techniques for debugging HPC applications
Rogue Wave Software
 
OSMC 2012 | Shinken by Jean Gabès
OSMC 2012 | Shinken by Jean GabèsOSMC 2012 | Shinken by Jean Gabès
OSMC 2012 | Shinken by Jean Gabès
NETWAYS
 
PL22 - Backup and Restore Performance.pptx
PL22 - Backup and Restore Performance.pptxPL22 - Backup and Restore Performance.pptx
PL22 - Backup and Restore Performance.pptx
Vinicius M Grippa
 
Sprint 65
Sprint 65Sprint 65
Sprint 65
ManageIQ
 
Scaling Magento
Scaling MagentoScaling Magento
Scaling Magento
Copious
 
Make your data fly - Building data platform in AWS
Make your data fly - Building data platform in AWSMake your data fly - Building data platform in AWS
Make your data fly - Building data platform in AWS
Kimmo Kantojärvi
 
Sprint 62
Sprint 62Sprint 62
Sprint 62
ManageIQ
 
Sprint 45 review
Sprint 45 reviewSprint 45 review
Sprint 45 review
ManageIQ
 
Sprint 66
Sprint 66Sprint 66
Sprint 66
ManageIQ
 
Sprint 58
Sprint 58Sprint 58
Sprint 58
ManageIQ
 
Webinar slides: Free Monitoring (on Steroids) for MySQL, MariaDB, PostgreSQL ...
Webinar slides: Free Monitoring (on Steroids) for MySQL, MariaDB, PostgreSQL ...Webinar slides: Free Monitoring (on Steroids) for MySQL, MariaDB, PostgreSQL ...
Webinar slides: Free Monitoring (on Steroids) for MySQL, MariaDB, PostgreSQL ...
Severalnines
 
Webinar slides: How to Achieve PCI Compliance for MySQL & MariaDB with Cluste...
Webinar slides: How to Achieve PCI Compliance for MySQL & MariaDB with Cluste...Webinar slides: How to Achieve PCI Compliance for MySQL & MariaDB with Cluste...
Webinar slides: How to Achieve PCI Compliance for MySQL & MariaDB with Cluste...
Severalnines
 
Pivotal Greenplum Cloud Marketplaces - Greenplum Summit 2019
Pivotal Greenplum Cloud Marketplaces - Greenplum Summit 2019Pivotal Greenplum Cloud Marketplaces - Greenplum Summit 2019
Pivotal Greenplum Cloud Marketplaces - Greenplum Summit 2019
VMware Tanzu
 
HKNOG 6.0 Next Generation Networks - will automation put us out of jobs?
HKNOG 6.0 Next Generation Networks - will automation put us out of jobs?HKNOG 6.0 Next Generation Networks - will automation put us out of jobs?
HKNOG 6.0 Next Generation Networks - will automation put us out of jobs?
Tom Paseka
 
Tips to drive maria db cluster performance for nextcloud
Tips to drive maria db cluster performance for nextcloudTips to drive maria db cluster performance for nextcloud
Tips to drive maria db cluster performance for nextcloud
Severalnines
 
Data Science in the Cloud @StitchFix
Data Science in the Cloud @StitchFixData Science in the Cloud @StitchFix
Data Science in the Cloud @StitchFix
C4Media
 
Webinar slides: How to automate and manage MongoDB & Percona Server for MongoDB
Webinar slides: How to automate and manage MongoDB & Percona Server for MongoDBWebinar slides: How to automate and manage MongoDB & Percona Server for MongoDB
Webinar slides: How to automate and manage MongoDB & Percona Server for MongoDB
Severalnines
 
Sprint 44 review
Sprint 44 reviewSprint 44 review
Sprint 44 review
ManageIQ
 
Advanced technologies and techniques for debugging HPC applications
Advanced technologies and techniques for debugging HPC applicationsAdvanced technologies and techniques for debugging HPC applications
Advanced technologies and techniques for debugging HPC applications
Rogue Wave Software
 
OSMC 2012 | Shinken by Jean Gabès
OSMC 2012 | Shinken by Jean GabèsOSMC 2012 | Shinken by Jean Gabès
OSMC 2012 | Shinken by Jean Gabès
NETWAYS
 
PL22 - Backup and Restore Performance.pptx
PL22 - Backup and Restore Performance.pptxPL22 - Backup and Restore Performance.pptx
PL22 - Backup and Restore Performance.pptx
Vinicius M Grippa
 
Scaling Magento
Scaling MagentoScaling Magento
Scaling Magento
Copious
 
Make your data fly - Building data platform in AWS
Make your data fly - Building data platform in AWSMake your data fly - Building data platform in AWS
Make your data fly - Building data platform in AWS
Kimmo Kantojärvi
 
Sprint 45 review
Sprint 45 reviewSprint 45 review
Sprint 45 review
ManageIQ
 
Ad

More from Severalnines (14)

The Long Term Cost of Managed DBaaS vs Sovereign DBaaS
The Long Term Cost of Managed DBaaS vs Sovereign DBaaSThe Long Term Cost of Managed DBaaS vs Sovereign DBaaS
The Long Term Cost of Managed DBaaS vs Sovereign DBaaS
Severalnines
 
Sovereign DBaaS_ A Practical Vision for Self-Implementation of DBaaS.pptx
Sovereign DBaaS_ A Practical Vision for Self-Implementation of DBaaS.pptxSovereign DBaaS_ A Practical Vision for Self-Implementation of DBaaS.pptx
Sovereign DBaaS_ A Practical Vision for Self-Implementation of DBaaS.pptx
Severalnines
 
PostgreSQL on AWS Aurora/Azure Cosmos VS EC2/Azure VMs
PostgreSQL on AWS Aurora/Azure Cosmos VS EC2/Azure VMsPostgreSQL on AWS Aurora/Azure Cosmos VS EC2/Azure VMs
PostgreSQL on AWS Aurora/Azure Cosmos VS EC2/Azure VMs
Severalnines
 
Localhost Conference 2024_ Building a Flexible and Scalable Database Strategy...
Localhost Conference 2024_ Building a Flexible and Scalable Database Strategy...Localhost Conference 2024_ Building a Flexible and Scalable Database Strategy...
Localhost Conference 2024_ Building a Flexible and Scalable Database Strategy...
Severalnines
 
SREDAY London 2024 | Cloud Native Technologies: The Building Blocks of Modern...
SREDAY London 2024 | Cloud Native Technologies: The Building Blocks of Modern...SREDAY London 2024 | Cloud Native Technologies: The Building Blocks of Modern...
SREDAY London 2024 | Cloud Native Technologies: The Building Blocks of Modern...
Severalnines
 
Building a Sovereign DBaaS on K8s OpenInfra Summit Asia 2024.pdf
Building a Sovereign DBaaS on K8s OpenInfra Summit Asia 2024.pdfBuilding a Sovereign DBaaS on K8s OpenInfra Summit Asia 2024.pdf
Building a Sovereign DBaaS on K8s OpenInfra Summit Asia 2024.pdf
Severalnines
 
S-DBaaS Community Call | Introduction to Sovereign DBaaS: The why, what and how
S-DBaaS Community Call | Introduction to Sovereign DBaaS: The why, what and howS-DBaaS Community Call | Introduction to Sovereign DBaaS: The why, what and how
S-DBaaS Community Call | Introduction to Sovereign DBaaS: The why, what and how
Severalnines
 
WEBINAR SLIDES: CCX for Cloud Service Providers
WEBINAR SLIDES: CCX for Cloud Service ProvidersWEBINAR SLIDES: CCX for Cloud Service Providers
WEBINAR SLIDES: CCX for Cloud Service Providers
Severalnines
 
LIVE DEMO: CCX for CSPs, a drop-in DBaaS solution
LIVE DEMO: CCX for CSPs, a drop-in DBaaS solutionLIVE DEMO: CCX for CSPs, a drop-in DBaaS solution
LIVE DEMO: CCX for CSPs, a drop-in DBaaS solution
Severalnines
 
Kubernetes at Scale: Going Multi-Cluster with Istio
Kubernetes at Scale:  Going Multi-Cluster  with IstioKubernetes at Scale:  Going Multi-Cluster  with Istio
Kubernetes at Scale: Going Multi-Cluster with Istio
Severalnines
 
DIY DBaaS: A guide to building your own full-featured DBaaS
DIY DBaaS: A guide to building your own full-featured DBaaSDIY DBaaS: A guide to building your own full-featured DBaaS
DIY DBaaS: A guide to building your own full-featured DBaaS
Severalnines
 
Cloud's future runs through Sovereign DBaaS
Cloud's future runs through Sovereign DBaaSCloud's future runs through Sovereign DBaaS
Cloud's future runs through Sovereign DBaaS
Severalnines
 
Webinar slides: How to Manage Replication Failover Processes for MySQL, Maria...
Webinar slides: How to Manage Replication Failover Processes for MySQL, Maria...Webinar slides: How to Manage Replication Failover Processes for MySQL, Maria...
Webinar slides: How to Manage Replication Failover Processes for MySQL, Maria...
Severalnines
 
Polyglot Persistence Utilizing Open Source Databases as a Swiss Pocket Knife
Polyglot Persistence Utilizing Open Source Databases as a Swiss Pocket KnifePolyglot Persistence Utilizing Open Source Databases as a Swiss Pocket Knife
Polyglot Persistence Utilizing Open Source Databases as a Swiss Pocket Knife
Severalnines
 
The Long Term Cost of Managed DBaaS vs Sovereign DBaaS
The Long Term Cost of Managed DBaaS vs Sovereign DBaaSThe Long Term Cost of Managed DBaaS vs Sovereign DBaaS
The Long Term Cost of Managed DBaaS vs Sovereign DBaaS
Severalnines
 
Sovereign DBaaS_ A Practical Vision for Self-Implementation of DBaaS.pptx
Sovereign DBaaS_ A Practical Vision for Self-Implementation of DBaaS.pptxSovereign DBaaS_ A Practical Vision for Self-Implementation of DBaaS.pptx
Sovereign DBaaS_ A Practical Vision for Self-Implementation of DBaaS.pptx
Severalnines
 
PostgreSQL on AWS Aurora/Azure Cosmos VS EC2/Azure VMs
PostgreSQL on AWS Aurora/Azure Cosmos VS EC2/Azure VMsPostgreSQL on AWS Aurora/Azure Cosmos VS EC2/Azure VMs
PostgreSQL on AWS Aurora/Azure Cosmos VS EC2/Azure VMs
Severalnines
 
Localhost Conference 2024_ Building a Flexible and Scalable Database Strategy...
Localhost Conference 2024_ Building a Flexible and Scalable Database Strategy...Localhost Conference 2024_ Building a Flexible and Scalable Database Strategy...
Localhost Conference 2024_ Building a Flexible and Scalable Database Strategy...
Severalnines
 
SREDAY London 2024 | Cloud Native Technologies: The Building Blocks of Modern...
SREDAY London 2024 | Cloud Native Technologies: The Building Blocks of Modern...SREDAY London 2024 | Cloud Native Technologies: The Building Blocks of Modern...
SREDAY London 2024 | Cloud Native Technologies: The Building Blocks of Modern...
Severalnines
 
Building a Sovereign DBaaS on K8s OpenInfra Summit Asia 2024.pdf
Building a Sovereign DBaaS on K8s OpenInfra Summit Asia 2024.pdfBuilding a Sovereign DBaaS on K8s OpenInfra Summit Asia 2024.pdf
Building a Sovereign DBaaS on K8s OpenInfra Summit Asia 2024.pdf
Severalnines
 
S-DBaaS Community Call | Introduction to Sovereign DBaaS: The why, what and how
S-DBaaS Community Call | Introduction to Sovereign DBaaS: The why, what and howS-DBaaS Community Call | Introduction to Sovereign DBaaS: The why, what and how
S-DBaaS Community Call | Introduction to Sovereign DBaaS: The why, what and how
Severalnines
 
WEBINAR SLIDES: CCX for Cloud Service Providers
WEBINAR SLIDES: CCX for Cloud Service ProvidersWEBINAR SLIDES: CCX for Cloud Service Providers
WEBINAR SLIDES: CCX for Cloud Service Providers
Severalnines
 
LIVE DEMO: CCX for CSPs, a drop-in DBaaS solution
LIVE DEMO: CCX for CSPs, a drop-in DBaaS solutionLIVE DEMO: CCX for CSPs, a drop-in DBaaS solution
LIVE DEMO: CCX for CSPs, a drop-in DBaaS solution
Severalnines
 
Kubernetes at Scale: Going Multi-Cluster with Istio
Kubernetes at Scale:  Going Multi-Cluster  with IstioKubernetes at Scale:  Going Multi-Cluster  with Istio
Kubernetes at Scale: Going Multi-Cluster with Istio
Severalnines
 
DIY DBaaS: A guide to building your own full-featured DBaaS
DIY DBaaS: A guide to building your own full-featured DBaaSDIY DBaaS: A guide to building your own full-featured DBaaS
DIY DBaaS: A guide to building your own full-featured DBaaS
Severalnines
 
Cloud's future runs through Sovereign DBaaS
Cloud's future runs through Sovereign DBaaSCloud's future runs through Sovereign DBaaS
Cloud's future runs through Sovereign DBaaS
Severalnines
 
Webinar slides: How to Manage Replication Failover Processes for MySQL, Maria...
Webinar slides: How to Manage Replication Failover Processes for MySQL, Maria...Webinar slides: How to Manage Replication Failover Processes for MySQL, Maria...
Webinar slides: How to Manage Replication Failover Processes for MySQL, Maria...
Severalnines
 
Polyglot Persistence Utilizing Open Source Databases as a Swiss Pocket Knife
Polyglot Persistence Utilizing Open Source Databases as a Swiss Pocket KnifePolyglot Persistence Utilizing Open Source Databases as a Swiss Pocket Knife
Polyglot Persistence Utilizing Open Source Databases as a Swiss Pocket Knife
Severalnines
 
Ad

Recently uploaded (20)

最新版西班牙加泰罗尼亚国际大学毕业证(UIC毕业证书)原版定制
最新版西班牙加泰罗尼亚国际大学毕业证(UIC毕业证书)原版定制最新版西班牙加泰罗尼亚国际大学毕业证(UIC毕业证书)原版定制
最新版西班牙加泰罗尼亚国际大学毕业证(UIC毕业证书)原版定制
Taqyea
 
MOBILE PHONE DATA presentation with all necessary details
MOBILE PHONE DATA presentation with all necessary detailsMOBILE PHONE DATA presentation with all necessary details
MOBILE PHONE DATA presentation with all necessary details
benamorraj
 
Google_Cloud_Computing_Fundamentals.pptx
Google_Cloud_Computing_Fundamentals.pptxGoogle_Cloud_Computing_Fundamentals.pptx
Google_Cloud_Computing_Fundamentals.pptx
ektadangwal2005
 
Vigilanti-Cura-Protecting-the-Faith.pptx
Vigilanti-Cura-Protecting-the-Faith.pptxVigilanti-Cura-Protecting-the-Faith.pptx
Vigilanti-Cura-Protecting-the-Faith.pptx
secretarysocom
 
PPT 18.03.2023.pptx for i smart programme
PPT 18.03.2023.pptx for i smart programmePPT 18.03.2023.pptx for i smart programme
PPT 18.03.2023.pptx for i smart programme
AbhimanShastry
 
Darley - BSides Nairobi (2025-06-07) Epochalypse 2038 - Time is Not on Our Si...
Darley - BSides Nairobi (2025-06-07) Epochalypse 2038 - Time is Not on Our Si...Darley - BSides Nairobi (2025-06-07) Epochalypse 2038 - Time is Not on Our Si...
Darley - BSides Nairobi (2025-06-07) Epochalypse 2038 - Time is Not on Our Si...
treyka
 
rosoft PowcgnggerPoint Presentation.pptx
rosoft PowcgnggerPoint Presentation.pptxrosoft PowcgnggerPoint Presentation.pptx
rosoft PowcgnggerPoint Presentation.pptx
sirbabu778
 
3D Graphics an introduction and details .pptx
3D Graphics an introduction and details .pptx3D Graphics an introduction and details .pptx
3D Graphics an introduction and details .pptx
islamicknowledge5224
 
Unlocking Business Growth Through Targeted Social Engagement
Unlocking Business Growth Through Targeted Social EngagementUnlocking Business Growth Through Targeted Social Engagement
Unlocking Business Growth Through Targeted Social Engagement
Digital Guider
 
LpQuantueer rtwrt 1e erere errerqer m.ppt
LpQuantueer rtwrt 1e erere errerqer m.pptLpQuantueer rtwrt 1e erere errerqer m.ppt
LpQuantueer rtwrt 1e erere errerqer m.ppt
cyberesearchprof
 
ICP -2 Review – What It Is, and How to Participate and Provide Your Feedback
ICP -2 Review – What It Is, and How to Participate and Provide Your FeedbackICP -2 Review – What It Is, and How to Participate and Provide Your Feedback
ICP -2 Review – What It Is, and How to Participate and Provide Your Feedback
APNIC
 
AI theory work for students to understand the logic
AI theory work for students to understand the logicAI theory work for students to understand the logic
AI theory work for students to understand the logic
areeba15775n
 
Quantiuwewe e3er14e we3223 32222 m2.pptx
Quantiuwewe e3er14e we3223 32222 m2.pptxQuantiuwewe e3er14e we3223 32222 m2.pptx
Quantiuwewe e3er14e we3223 32222 m2.pptx
cyberesearchprof
 
simple-presentationtestingdocument2007.pptx
simple-presentationtestingdocument2007.pptxsimple-presentationtestingdocument2007.pptx
simple-presentationtestingdocument2007.pptx
ashokjayapal
 
10 Latest Technologies and Their Benefits to End.pptx
10 Latest Technologies and Their Benefits to End.pptx10 Latest Technologies and Their Benefits to End.pptx
10 Latest Technologies and Their Benefits to End.pptx
EphraimOOghodero
 
Internet_of_Things_Presentation_by-Humera.pptx
Internet_of_Things_Presentation_by-Humera.pptxInternet_of_Things_Presentation_by-Humera.pptx
Internet_of_Things_Presentation_by-Humera.pptx
cshumerabashir
 
最新版英国北安普顿大学毕业证(UoN毕业证书)原版定制
最新版英国北安普顿大学毕业证(UoN毕业证书)原版定制最新版英国北安普顿大学毕业证(UoN毕业证书)原版定制
最新版英国北安普顿大学毕业证(UoN毕业证书)原版定制
Taqyea
 
How to Make Money as a Cam Model – Tips, Tools & Real Talk
How to Make Money as a Cam Model – Tips, Tools & Real TalkHow to Make Money as a Cam Model – Tips, Tools & Real Talk
How to Make Money as a Cam Model – Tips, Tools & Real Talk
Cam Sites Expert
 
Cloud Computing - iCloud by Hamza Anwaar .pptx
Cloud Computing - iCloud by Hamza Anwaar .pptxCloud Computing - iCloud by Hamza Anwaar .pptx
Cloud Computing - iCloud by Hamza Anwaar .pptx
islamicknowledge5224
 
Inter-Mirifica-Navigating-Media-in-the-Modern-World.pptx
Inter-Mirifica-Navigating-Media-in-the-Modern-World.pptxInter-Mirifica-Navigating-Media-in-the-Modern-World.pptx
Inter-Mirifica-Navigating-Media-in-the-Modern-World.pptx
secretarysocom
 
最新版西班牙加泰罗尼亚国际大学毕业证(UIC毕业证书)原版定制
最新版西班牙加泰罗尼亚国际大学毕业证(UIC毕业证书)原版定制最新版西班牙加泰罗尼亚国际大学毕业证(UIC毕业证书)原版定制
最新版西班牙加泰罗尼亚国际大学毕业证(UIC毕业证书)原版定制
Taqyea
 
MOBILE PHONE DATA presentation with all necessary details
MOBILE PHONE DATA presentation with all necessary detailsMOBILE PHONE DATA presentation with all necessary details
MOBILE PHONE DATA presentation with all necessary details
benamorraj
 
Google_Cloud_Computing_Fundamentals.pptx
Google_Cloud_Computing_Fundamentals.pptxGoogle_Cloud_Computing_Fundamentals.pptx
Google_Cloud_Computing_Fundamentals.pptx
ektadangwal2005
 
Vigilanti-Cura-Protecting-the-Faith.pptx
Vigilanti-Cura-Protecting-the-Faith.pptxVigilanti-Cura-Protecting-the-Faith.pptx
Vigilanti-Cura-Protecting-the-Faith.pptx
secretarysocom
 
PPT 18.03.2023.pptx for i smart programme
PPT 18.03.2023.pptx for i smart programmePPT 18.03.2023.pptx for i smart programme
PPT 18.03.2023.pptx for i smart programme
AbhimanShastry
 
Darley - BSides Nairobi (2025-06-07) Epochalypse 2038 - Time is Not on Our Si...
Darley - BSides Nairobi (2025-06-07) Epochalypse 2038 - Time is Not on Our Si...Darley - BSides Nairobi (2025-06-07) Epochalypse 2038 - Time is Not on Our Si...
Darley - BSides Nairobi (2025-06-07) Epochalypse 2038 - Time is Not on Our Si...
treyka
 
rosoft PowcgnggerPoint Presentation.pptx
rosoft PowcgnggerPoint Presentation.pptxrosoft PowcgnggerPoint Presentation.pptx
rosoft PowcgnggerPoint Presentation.pptx
sirbabu778
 
3D Graphics an introduction and details .pptx
3D Graphics an introduction and details .pptx3D Graphics an introduction and details .pptx
3D Graphics an introduction and details .pptx
islamicknowledge5224
 
Unlocking Business Growth Through Targeted Social Engagement
Unlocking Business Growth Through Targeted Social EngagementUnlocking Business Growth Through Targeted Social Engagement
Unlocking Business Growth Through Targeted Social Engagement
Digital Guider
 
LpQuantueer rtwrt 1e erere errerqer m.ppt
LpQuantueer rtwrt 1e erere errerqer m.pptLpQuantueer rtwrt 1e erere errerqer m.ppt
LpQuantueer rtwrt 1e erere errerqer m.ppt
cyberesearchprof
 
ICP -2 Review – What It Is, and How to Participate and Provide Your Feedback
ICP -2 Review – What It Is, and How to Participate and Provide Your FeedbackICP -2 Review – What It Is, and How to Participate and Provide Your Feedback
ICP -2 Review – What It Is, and How to Participate and Provide Your Feedback
APNIC
 
AI theory work for students to understand the logic
AI theory work for students to understand the logicAI theory work for students to understand the logic
AI theory work for students to understand the logic
areeba15775n
 
Quantiuwewe e3er14e we3223 32222 m2.pptx
Quantiuwewe e3er14e we3223 32222 m2.pptxQuantiuwewe e3er14e we3223 32222 m2.pptx
Quantiuwewe e3er14e we3223 32222 m2.pptx
cyberesearchprof
 
simple-presentationtestingdocument2007.pptx
simple-presentationtestingdocument2007.pptxsimple-presentationtestingdocument2007.pptx
simple-presentationtestingdocument2007.pptx
ashokjayapal
 
10 Latest Technologies and Their Benefits to End.pptx
10 Latest Technologies and Their Benefits to End.pptx10 Latest Technologies and Their Benefits to End.pptx
10 Latest Technologies and Their Benefits to End.pptx
EphraimOOghodero
 
Internet_of_Things_Presentation_by-Humera.pptx
Internet_of_Things_Presentation_by-Humera.pptxInternet_of_Things_Presentation_by-Humera.pptx
Internet_of_Things_Presentation_by-Humera.pptx
cshumerabashir
 
最新版英国北安普顿大学毕业证(UoN毕业证书)原版定制
最新版英国北安普顿大学毕业证(UoN毕业证书)原版定制最新版英国北安普顿大学毕业证(UoN毕业证书)原版定制
最新版英国北安普顿大学毕业证(UoN毕业证书)原版定制
Taqyea
 
How to Make Money as a Cam Model – Tips, Tools & Real Talk
How to Make Money as a Cam Model – Tips, Tools & Real TalkHow to Make Money as a Cam Model – Tips, Tools & Real Talk
How to Make Money as a Cam Model – Tips, Tools & Real Talk
Cam Sites Expert
 
Cloud Computing - iCloud by Hamza Anwaar .pptx
Cloud Computing - iCloud by Hamza Anwaar .pptxCloud Computing - iCloud by Hamza Anwaar .pptx
Cloud Computing - iCloud by Hamza Anwaar .pptx
islamicknowledge5224
 
Inter-Mirifica-Navigating-Media-in-the-Modern-World.pptx
Inter-Mirifica-Navigating-Media-in-the-Modern-World.pptxInter-Mirifica-Navigating-Media-in-the-Modern-World.pptx
Inter-Mirifica-Navigating-Media-in-the-Modern-World.pptx
secretarysocom
 

Webinar slides: How to Automate & Manage PostgreSQL with ClusterControl

  • 1. January 2019 Automation & Management of PostgreSQL with ClusterControl Sebastian Insausti Presenter [email protected]
  • 2. Copyright 2018 Severalnines AB I'm Jean-Jérôme from the Severalnines Team and I'm your host for today's webinar! Feel free to ask any questions in the Questions section of this application or via the Chat box. You can also contact me directly via the chat box or via email: [email protected] during or after the webinar. Your host & some logistics
  • 5. Copyright 2018 Severalnines AB Free to download Initial 30 days Enterprise trial Converts into free Community Edition Enterprise / paid versions available
  • 6. Copyright 2018 Severalnines AB Automation & Management Deployment (Free Community) ● Deploy a Cluster in Minutes ○ On-Prem ○ Cloud (AWS/Azure/Google) - paid Monitoring (Free Community) ● Systems View with 1 sec Resolution ● DB / OS stats & Performance Advisors ● Configurable Dashboards ● Query Analyzer ● Agentless & agent-based Management (Paid Features) ● Backup Management ● Upgrades & Patching ● Security & Compliance ● Operational Reports ● Automatic Recovery & Repair ● Performance Management ● Automatic Performance Advisors
  • 7. Copyright 2018 Severalnines AB Supported Databases
  • 8. Copyright 2018 Severalnines AB Our Customers
  • 9. Poll - multiple choice Copyright 2018 Severalnines AB Which method do you use to perform your DBA tasks? ● Manual actions ● Custom scripts ● External tools and utilities ● ClusterControl ● Others (please specify in the chat box)
  • 10. January 2019 Automation & Management of PostgreSQL with ClusterControl Sebastian Insausti Presenter [email protected]
  • 11. Copyright 2018 Severalnines ABCopyright 2018 Severalnines AB Managing PostgreSQL ● Requirements for managing production databases “The Old Way” ● Labour intensive, manual operations ● Scripts, tools and utilities ● What happens when the DBA leaves? Agenda Automation and Management with ClusterControl ● Deployment ● Monitoring & Alerting ● Performance Management ● Backup management ● High Availability setups ● Single VIP endpoint with Load Balancer ● Automatic Failover Live Demo
  • 12. Copyright 2018 Severalnines AB Copyright 2018 Severalnines AB Requirements for managing production databases
  • 13. Copyright 2018 Severalnines ABCopyright 2018 Severalnines AB Deployment ● Install ○ The first step to begin the game ● Secure ○ Keep your data safe and secure ● Configure ○ Environment requirements
  • 14. Copyright 2018 Severalnines ABCopyright 2018 Severalnines AB Monitoring & Alerting ● Define metrics ○ Database ○ Operating System ● Configure monitoring ○ Custom Monitoring ○ System Monitoring ● Configure alerts ○ Email alerts ○ Tool Integrations
  • 15. Copyright 2018 Severalnines ABCopyright 2018 Severalnines AB ● Important but complex task ● PostgreSQL is configured with compatibility and stability by default ● Depends on the hardware and on the system itself ● Performance queries Performance Management
  • 16. Copyright 2018 Severalnines ABCopyright 2018 Severalnines AB ● Backups Methods: ○ Logical backup: Plain text files with SQL statements ○ Physical backup: A copy of the datafiles ● Backup tasks: ○ Schedule ○ Rotation / Retention ○ Secure Backup ○ Verify Backup ○ Point-in-time recovery backup ○ Upload to external datacenter, e.g., cloud storage ○ Reporting Backup Management
  • 17. Copyright 2018 Severalnines ABCopyright 2018 Severalnines AB ● Define topology ○ Master-Slave ○ Master-Master ● Define replication type ○ Synchronous: There is no loss of data even if our master node is lost. The commits in the master must wait for a confirmation from the slave. ○ Asynchronous: There is a possibility of data loss in case we lose our master node. If the replica is not updated at the time of the incident, the information that has not been copied may be lost. ○ Logical Replication: Performed via SQL statements. ○ Physical Replication: Performed via internal data structure. ● Failover ● Single endpoint for application High Availability setups
  • 18. Poll - multiple choice Copyright 2018 Severalnines AB According to you, what are your most challenging tasks in production? ● A well tuned and secure configuration ● Monitoring uptime & Alerting ● Managing performance / queries ● Backup management ● Failover & High Availability
  • 19. Copyright 2018 Severalnines AB Copyright 2018 Severalnines AB "The Old Way"
  • 20. Copyright 2018 Severalnines ABCopyright 2018 Severalnines AB Deployment ● Installation: ○ Repositories or packages ○ Some packages dependencies could be required ● Secure installation: ○ Configuration files (pg_hba.conf or postgresql.conf) ○ Authentication ● Basic configuration: ○ For example: Listen address or wal_level ○ Require DBA or Sysadmin skills
  • 21. Copyright 2018 Severalnines ABCopyright 2018 Severalnines AB What to monitor ● Database ○ Queries ○ Sessions ○ Locks ○ IO ○ Replication ○ Backups ● System ○ CPU ○ Memory ○ Load Average ○ Network Monitoring & Alerting
  • 22. Copyright 2018 Severalnines ABCopyright 2018 Severalnines AB Performance Management ● Time consuming task ● There is not a standard configuration for this task ● Check charts ○ e.g: max_connections ● Database commands ○ EXPLAIN: Check the query plan ○ VACUUM: For several maintenance tasks ● Parameters ○ shared_buffers: Amount of memory that the database uses for shared memory ○ work_mem: Amount of memory used by internal operations like ORDER BY, DISTINCT, JOIN, among others ● Require deep DBA knowledge
  • 23. Copyright 2018 Severalnines ABCopyright 2018 Severalnines AB Backup Management ● Typically done using custom scripts ● Some just copy the datafiles (!) ● Schedule using cron ● Manual rotation ● No backup verification or PITR backup
  • 24. Copyright 2018 Severalnines ABCopyright 2018 Severalnines AB ● Master-Slave Topology ● Asynchronous replication ● Manual setup of slave ○ Install a new server ○ Copy data from master ○ Configure replication High Availability Setups
  • 25. Copyright 2018 Severalnines ABCopyright 2018 Severalnines AB Automatic Failover ● We need to know when we need the failover ● PostgreSQL itself does not include an automatic failover mechanism ● After failover, the applications need to know about the new master
  • 26. Copyright 2018 Severalnines ABCopyright 2018 Severalnines AB ● Load Balancer: ○ Balancing traffic ○ Redirect traffic to available nodes ○ Specify ports for different roles ○ It's an external component that requires installation, configuration and monitoring ● Virtual IP: ○ Keepalived is a linux service that allows to configure a virtual IP within an active/passive group of servers ○ Another external component that requires installation, configuration and monitoring Single VIP endpoint with Load Balancer
  • 27. Copyright 2018 Severalnines ABCopyright 2018 Severalnines AB ● Where is the documentation? ● How do all these scripts hang together? ● It is often hard to know how the database is managed ● There is nobody to take over what you did ● It can be a mess What happens when the DBA leaves?
  • 28. Copyright 2018 Severalnines AB Copyright 2018 Severalnines AB ClusterControl - PostgreSQL automation and management
  • 29. Copyright 2018 Severalnines AB ClusterControl
  • 30. Copyright 2018 Severalnines ABCopyright 2018 Severalnines AB Deployment
  • 31. Copyright 2018 Severalnines ABCopyright 2018 Severalnines AB Monitoring & Alerting
  • 32. Copyright 2018 Severalnines ABCopyright 2018 Severalnines AB Monitoring & Alerting
  • 33. Copyright 2018 Severalnines ABCopyright 2018 Severalnines AB Performance Management
  • 34. Copyright 2018 Severalnines ABCopyright 2018 Severalnines AB Backup Management
  • 35. Copyright 2018 Severalnines ABCopyright 2018 Severalnines AB High Availability Setups
  • 36. Copyright 2018 Severalnines ABCopyright 2018 Severalnines AB Single VIP endpoint with Load Balancer
  • 37. Copyright 2018 Severalnines ABCopyright 2018 Severalnines AB Automatic Failover
  • 38. Copyright 2018 Severalnines ABCopyright 2018 Severalnines AB ClusterControl CLI $ s9s cluster --list --long ID STATE TYPE OWNER GROUP NAME COMMENT 1 FAILURE galera system admins Galera1 Cluster failed to start. 2 STARTED postgresql_single system admins PostgreSQL1 All nodes are operational. 5 FAILURE replication system admins MySQL1 Cluster failed to start. Total: 3 $ s9s node --list --cluster-id=2 --long STAT VERSION CID CLUSTER HOST PORT COMMENT coC- 1.7.1.2965 2 PostgreSQL1 192.168.100.110 9500 Up and running. ?o-- 2.3.2 2 PostgreSQL1 192.168.100.110 9090 Process 'prometheus' is running. ho-- 1.5.18 2 PostgreSQL1 192.168.100.114 9600 Process 'haproxy' is running. koM- 1.3 2 PostgreSQL1 192.168.100.114 112 Process 'keepalived' is running. ho-- 1.5.18 2 PostgreSQL1 192.168.100.115 9600 Process 'haproxy' is running. ko-- 1.3 2 PostgreSQL1 192.168.100.115 112 Process 'keepalived' is running. poM- 10.5 2 PostgreSQL1 192.168.100.123 5432 Up and running. poS- 10.5 2 PostgreSQL1 192.168.100.124 5432 Up and running. poS- 10.5 2 PostgreSQL1 192.168.100.125 5432 Up and running. Total: 9
  • 39. Copyright 2018 Severalnines AB Copyright 2018 Severalnines AB Live Demo
  • 40. ● Deployment ● Add replication slave ● Add load balancer ● Deploy keepalived ● Monitoring ● Performance ● Backup ● Topology view ● CLI Cluster Control PostgreSQL Management Demo Copyright 2018 Severalnines AB
  • 41. Poll - multiple choice (choose one of below) Copyright 2018 Severalnines AB Where do you need the most improvements in your environment? ● Monitoring & Alerting ● Performance Management ● Backups ● High Availability & Automatic Failover ● Other (please specify in the chat box)
  • 42. Copyright 2018 Severalnines AB Copyright 2018 Severalnines AB Q & A
  • 43. Links & Resources ● ClusterControl for PostgreSQL ● Download / install ClusterControl ● ClusterControl Community Edition Page ● Contact us: [email protected]