Cloud Spanner. Rohit Gupta, Solutions

Transcription

1 Cloud Spanner Rohit Gupta, Solutions

2 Today s goals Provide a brief history of Spanner at Google Provide an explanation of Cloud Spanner Do a demo!

3 Built on the same infrastructure that powers Google Super-flexible compute Superior economics Always available storage Fastest, most reliable network Robust, easy to use Big Data solutions

4

5 GCP Regions Netherlands Belgium 2 London Montreal Oregon California 2 Iowa Finland Frankfurt 4 Tokyo N Virginia S Carolina Mumbai 2 São Paulo Taiwan Sydney Leased and owned fiber Edge points of presence (>100) # Future region and number of zones # Current region and number of zones SJC (JP, HK, SG) 201 Singapore

6 Background Why build Spanner?

7 Technical infrastructure at Google It s

8 Google s needs Horizontally Scaling Database ACID Transactions with global consistency No downtime!

9 Overview What is Cloud Spanner?

10

11 What is Cloud Spanner? Google s mission-critical scalable relational Database Service Fully managed, database service with global scale Traditional relational semantics: schemas, ACID transactions, SQL Automatic, synchronous replication within and across regions for availability Battle-tested within Google for 5+ yrs (AdWords, GooglePlay)

12 How does it compare?

13 Open standards Standard SQL (ANSI 2011) Encryption, Audit logging, Identity and Access Management Client libraries in popular languages (Java, Python, Go, Node.js, etc.) JDBC driver

14 Types of workloads Transactional Scale-out Global data plane Database consolidation Companies that have outgrown their single-instance RDBMS and have already moved to NoSQL solution, but need transactional consistency, or they are looking to move to a scalable solution Companies currently sharding databases because they need more read or write throughput than can be placed on a single node Companies and/or developers building applications that have global data and need strong consistency Companies that store their business data in multiple database products with variable maintenance overheads and capabilities and need consolidation of their data

15 Architecture overview Cloud Spanner instance Zone 1 Zone 2 Zone DB 1 DB 1 DB 1 DB 2 DB 2 DB 2

16 Data replication Update Zone 1 Zone 2 Zone Table 1 Table 1 Table 1 Table 2 Table 2 Table 2

17 Relational Data Layout SingerId SingerName SingerId AlbumId AlbumName 1 Beatles 1 1 Help! 2 U2 1 2 Abbey Road Pink Floyd 1 The Wall

18 Interleave Data Layout 1 Beatles 1 1 Help! 1 2 Abbey Road 2 U2 Pink Floyd 1 The Wall

19 Relational data model CREATE TABLE Singers ( SingerId INT64 NOT NULL, SingerName STRING(MAX), ) PRIMARY KEY(SingerId); CREATE TABLE Albums ( SingerId INT64 NOT NULL, AlbumId INT64 NOT NULL, AlbumName STRING(MAX), ) PRIMARY KEY(SingerId, AlbumId) INTERLEAVE IN PARENT Singers; No Downtime Schema Migrations ALTER TABLE Singers ADD COLUMN Age INT64;

20 Getting started in Python

21 Storage & Database Portfolio In memory App Engine Memcache Relational Cloud SQL Cloud Spanner Non-relational Cloud Datastore Cloud Bigtable Good for: Web/mobile apps, gaming Good for: Web frameworks Good for: Good for: Good for: RDBMS+scale, HA, HTAP Hierarchical, mobile, web Heavy read + write, events, Such as: Game state, user sessions Such as: CMS, ecommerce Such as: Such as: Such as: User metadata, Ad/Fin/MarTech User profiles, Game State AdTech, financial, IoT Object Warehouse Cloud Storage BigQuery Good for: Binary or object data Good for: Enterprise data warehouse Such as: Images, media serving, backups Such as: Analytics, dashboards

22 Is your data structured? No Do you need Mobile SDK s? No Yes Is your workload analytics? Yes Firebase Storage Cloud Storage Yes No Is your data relational? Yes No Do you need Mobile SDK s? Do you need horizontal scalability? No Cloud SQL No Yes Cloud Spanner Cloud Datastore Do you need updates or low-latency? Yes Yes Firebase Realtime DB Cloud Bigtable No BigQuery

23 Partner integrations Launch partners Committed partners

24 Whats Next Checkout Google Cloud Spanner at cloud.google.com/spanner Cloud Spanner youtu.be/tzhe7sundbg Cloud Spanner Case Study - Quizlet Case Study

25 Thank you