MSc, Computer & Systems TalTech. Writes on 2ndQuadrant blog From Turkey Lives in

Size: px

Start display at page:

Download "MSc, Computer & Systems TalTech. Writes on 2ndQuadrant blog From Turkey Lives in"

Beryl Warner
5 years ago
Views:

1 Gülçin Yıldırım Jelínek 1 Multi-Master PostgreSQL Architectures in Cloud

select * from me; Board of Directors @ PostgreSQL Europe Cloud Services Manager @

2 select * from me; Board of PostgreSQL Europe Cloud Services 2ndQuadrant Main Prague PostgreSQL Meetup Postgres Women MSc, Computer & Systems TalTech BSc, Applied Yildiz Technical University Writes on 2ndQuadrant blog From Turkey Lives in Github: gulcin 2

3 Agenda What is Multi-Master? Physical vs Logical Replication Postgres-BDR Multi-Master Architectures Multi-Master Postgres in Cloud (GDS) Our Experience with Cloud Postgres Conclusion Questions 3

4 What is Multi-Master? Replicate writes between multiple masters Asynchronous with conflicts Conflict-free (consensus) 4

5 Physical vs Logical Replication Replay WAL WAL cannot be changed Bit copy of upstream All or nothing Same major version Can't write to downstream Logical decoding Extension API Row changes Committed changes Selective replication Cross-version Can write to all nodes 5

6 Physical vs Logical Replication 6

Optimistic conflict detection (after commit) Automatic

7 Postgres-BDR Multi-master Asynchronous Eventually consistent Does not prevent concurrent writes Optimistic conflict detection (after commit) Automatic conflict resolution Used for Logical Replication development in PG 7

8 Multi-Master Architectures - I Geographically distributed cluster 8

9 Multi-Master Architectures - II AlwaysOn Architecture 9

10 Multi-Master Architectures - II M-Lead Connection Router Application AlwaysOn Architecture 9

11 Multi-Master Architectures - II Postgres-BDR M-Lead M-Shadow Connection Router Application AlwaysOn Architecture 9

12 Global Database as a Service Bundled up best PostgreSQL practices into our cloud service, with high-availability, and 24x7 support by the best PostgreSQL engineers! We develop We host We manage We support YOU USE! 10

13 GDS Flavours 11

14 Single Master Development Test 1 primary database No support 1 primary database 1 replica database Gold Support Production 1 primary database 2 replica databases Backups Platinum Support 12

15 Multi Master Bi-Directional Replication with Postgres-BDR 3.0 High availability Geographically distributed cluster Zero Downtime Upgrades Different Postgres versions Flexibility Different configuration Different instance sizes (CPU, disk, memory etc) 13

16 Multi Master Architecture bi-directional replication physical rep. physical rep. subcluster a subcluster b geo cluster 14

17 AlwaysOn Provides at least 4 Nines (99.99%) availability Deployed in single region with two different availability zones: 2 BDR primary 2 physical replica Backup Very High Availability described in the BDR whitepaper. 15

18 AlwaysOn Architecture bi-directional replication physical rep. M-Lead M-Shadow 16

19 How to Connect to your DB? 17

20 How to Connect to your DB? 1. Set your database password first 2. Choose the instance you want to connect 3. Choose one of the provided connection string types 4. Connect with your db client 17

21 How to Connect to your DB? 1. Set your database password first 2. Choose the instance you want to connect 3. Choose one of the provided connection string types 4. Connect with your db client 17

22 How to Connect to your DB? 1. Set your database password first 2. Choose the instance you want to connect 3. Choose one of the provided connection string types 4. Connect with your db client 17

23 How to Connect to your DB? 1. Set your database password first 2. Choose the instance you want to connect 3. Choose one of the provided connection string types 4. Connect with your db client 17

24 How to Connect to your DB? 1. Set your database password first 2. Choose the instance you want to connect 3. Choose one of the provided connection string types 4. Connect with your db client 17

25 How to Connect to your DB? 1. Set your database password first 2. Choose the instance you want to connect 3. Choose one of the provided connection string types 4. Connect with your db client 17

26 Database Configuration 18

27 Database Configuration 18

28 Database Configuration Search parameter name 18

29 Monitoring Dashboard 19

30 Dynamic Scaling 20

31 Dynamic Scaling 20

32 Dynamic Scaling 20

33 Dynamic Scaling 20

34 Logging 21

35 Logging 21

36 Logging Action log of all clusters 21

37 Logging Action log of all clusters 21

38 Logging Action log of all clusters Filter by cluster name 21

39 Benchmarks 22

40 Benchmarks 22

41 Benchmarks 22

42 Benchmarks TPS 22

43 Benchmarks TPS Latency 22

44 Security Authenticate with 2ndQuadrant SSO SSL connections only Encrypted Data at Rest No SUPERUSER VPC Peering IP Whitelisting 23

45 Automated Backups 24

46 Automated Backups 24

47 Automated Backups 24

48 Automated Backups 24

49 Automated Backups 24

50 Automated Backups Filter backups by status and cluster 24

51 Scheduled Backups 25

52 Scheduled Backups 25

53 Scheduled Backups Backup schedule 25

54 Scheduled Backups Backup schedule 25

55 Scheduled Backups Backup schedule Backup retention 25

56 Point-in-Time Recovery 26

57 Point-in-Time Recovery 26

58 Point-in-Time Recovery Pick time 26

59 Documentation 27

60 Documentation 27

61 Documentation Docs (WiP) 27

62 Documentation Docs (WiP) 27

63 Documentation Docs (WiP) Interactive API docs 27

64 Postgres Cloud Manager 28

65 Conclusion Postgres in Cloud is a go! Multi-Master adds new possibilities It's possible to create your own cloud independent of the platform Automation enables easy management Postgres Support applies to Cloud! 29

66 Tešekkürler! Questions? 30

Automated Upgrades of PostgreSQL Clusters in Cloud

Gülçin Yıldırım Automated Upgrades of PostgreSQL Clusters in Cloud 1 select * from me; Site Reliability Engineer @ 2ndQuadrant Board Member @ PostgreSQL Europe MSc Comp. & Systems Eng. @ Tallinn University