Managing Data in Microservices. Randy linkedin.com/in/randyshoup

Size: px

Start display at page:

Download "Managing Data in Microservices. Randy linkedin.com/in/randyshoup"

Kevin Barber
5 years ago
Views:

1 Managing Data in Micrservices Randy linkedin.cm/in/randyshup

2 Backgrund VP Engineering at Stitch Fix Using technlgy and data science t revlutinize clthing retail Cnsulting CTO as a service Helping cmpanies mve fast at scale J Directr f Engineering fr Ggle App Engine Wrld s largest Platfrm-as-a-Service Chief Engineer at ebay Evlving multiple generatins f ebay s infrastructure

3 Stitch linkedin.cm/in/randyshup

4 Stitch linkedin.cm/in/randyshup

5 Stitch linkedin.cm/in/randyshup

6 Stitch linkedin.cm/in/randyshup

7 Persnalized Recmmendatins Inventry Algrithmic recmmendatins Machine linkedin.cm/in/randyshup

8 Expert Human Curatin Algrithmic recmmendatins Human linkedin.cm/in/randyshup

9 Data at the Center 1:1 Rati f Data Science t Engineering Mre than 100 sftware engineers ~80 data scientists and algrithm develpers Unique rati in ur industry Apply intelligence t *every* part f the business Buying Inventry management Lgistics ptimizatin Styling recmmendatins Demand predictin Humans and machines augmenting each linkedin.cm/in/randyshup

10 Design Gals Feature Velcity Teams can mve rapidly and independently Scalability Cmpnents can be scaled independently depending n lad Resilience Cmpnent failures are islated, d nt linkedin.cm/in/randyshup

11 High-Perfrming Organizatins Multiple deplys per day vs. ne per mnth Cmmit t deply in less than 1 hur vs. ne week Recver frm failure in less than 1 hur vs. ne day Change failure rate f 0-15% vs % linkedin.cm/in/randyshup

12 High-Perfrming Organizatins è2.5x mre likely t exceed business gals Prfitability Market share Prductivity linkedin.cm/in/randyshup

13 Tell us hw yu did things at Ggle and ebay. Sure, I will tell yu, but yu have t prmise nt t d them! [ yet]

14 Evlutin t Micrservices ebay 5 th generatin tday Mnlithic Perl à Mnlithic C++ à Java à micrservices Twitter 3 rd generatin tday Mnlithic Rails à JS / Rails / Scala à micrservices Amazn Nth generatin tday Mnlithic Perl / C++ à Java / Scala à linkedin.cm/in/randyshup

15 N ne starts with micrservices Past a certain scale, everyne ends up with micrservices

16 If yu dn t end up regretting yur early technlgy decisins, yu prbably verengineered.

17 Micrservices Single-purpse Simple, well-defined interface Mdular and independent A B C D E

18 Micrservices Single-purpse Simple, well-defined interface Mdular and independent Islated persistence (!) A B C D E

19 Extracting Micrservices Prblem: Mnlithic shared DB stitchfix.cm Styling app Warehuse app Merch app CS app Lgistics app Payments service Prfile service Clients Shipments Items Styles, SKUs Warehuses etc.

20 Extracting Micrservices Decuple applicatins / services frm shared DB stitchfix.cm Styling app Warehuse app Merch app CS app Lgistics app Payments service Prfile service Clients Shipments Items Styles, SKUs Warehuses etc.

21 Extracting Micrservices Decuple applicatins / services frm shared DB Styling app Warehuse app cre_client cre_sku cre_item

22 Extracting Micrservices Step 1: Create a service Styling app Warehuse app client-service cre_client cre_sku cre_item

23 Extracting Micrservices Step 2: Applicatins use the service Styling app Warehuse app client-service cre_client cre_sku cre_item

24 Extracting Micrservices Step 3: Mve data t private database Styling app Warehuse app client-service cre_client cre_sku cre_item

25 Extracting Micrservices Step 4: Rinse and Repeat Styling app Warehuse app client-service item-service cre_client cre_item cre_sku

26 Extracting Micrservices Step 4: Rinse and Repeat Styling app Warehuse app client-service item-service cre_client cre_item style-service cre_sku

27 With Micrservices, hw d we d Shared Data Jins Transactins

Events as First-Class Cnstruct A significant change in state Statement that sme interesting thing ccurred Traditinal 3-tier system Presentatin è interface / interactin Applicatin è

28 Events as First-Class Cnstruct A significant change in state Statement that sme interesting thing ccurred Traditinal 3-tier system Presentatin è interface / interactin Applicatin è stateless business lgic Persistence è database Furth fundamental building blck State changes è events 0 1 N cnsumers subscribe t the event, typically linkedin.cm/in/randyshup

29 Micrservices and Events Events are a first-class part f a service interface A service interface includes Synchrnus request-respnse (REST, grpc, etc) Events the service prduces Events the service cnsumes Bulk reads and writes (ETL) The interface includes any mechanism fr getting data in r ut f the service linkedin.cm/in/randyshup

30 Micrservice Techniques: Shared Data Mnlithic database makes it easy t leverage shared data Where des shared data g in a micrservices linkedin.cm/in/randyshup

31 Micrservice Techniques: Shared Data Principle: Single System f Recrd Every piece f data is wned by a single service That service is the cannical system f recrd fr that data custmer-service styling-service custmer-search billing-service Every ther cpy is a read-nly, nn-authritative linkedin.cm/in/randyshup

32 Micrservice Techniques: Shared Data Apprach 1: Synchrnus Lkup Custmer service wns custmer data Fulfillment service calls custmer service in real time fulfillment-service linkedin.cm/in/randyshup

33 Micrservice Techniques: Shared Data Apprach 2: Async event + lcal cache Custmer service wns custmer data Custmer service sends address-updated event when custmer address changes Fulfillment service caches current custmer address custmer-service linkedin.cm/in/randyshup

34 Micrservice Techniques: Jins Mnlithic database makes it easy t jin tables SELECT FROM A INNER JOIN B ON Splitting the data acrss micrservices makes jins very linkedin.cm/in/randyshup

35 Micrservice Techniques: Jins Apprach 1: Jin in Client Applicatin Get a single custmer frm custmer-service Query matching rders fr that custmer frm rder-service rder-histry-page custmer-service rder-service Custmers Orders

36 Micrservice Techniques: Jins Apprach 2: Service that Materializes the View Listen t events frm item-service, events frm rder-service Maintain denrmalized jin f items and rders tgether in lcal strage item-service rder-feedback-service item-feedback-service Items Order Feedback

37 Micrservice Techniques: Jins Many cmmn systems d this Materialized view in database systems Mst NSQL systems Search engines Analytic linkedin.cm/in/randyshup

38 Micrservice Techniques: Wrkflws and Sagas Mnlithic database makes transactins acrss multiple entities easy BEGIN; INSERT INTO A ; UPDATE B...; COMMIT; Splitting data acrss services makes transactins very linkedin.cm/in/randyshup

39 Micrservice Techniques: Wrkflws and Sagas Transactin è Saga Mdel the transactin as a state machine f atmic events Reimplement as a wrkflw A B C Rll back by applying cmpensating peratins in reverse A B linkedin.cm/in/randyshup

40 Micrservice Techniques: Wrkflws and Sagas Many cmmn systems d this Payment prcessing Expense apprval Any multi-step linkedin.cm/in/randyshup

41 With Micrservices, hw d we d Shared Data Jins Transactins

Thanks! Stitch Fix is hiring! www.stitchfix.

42 Thanks! Stitch Fix is hiring! Based in San Francisc Hiring everywhere! Mre than half remte, all acrss US Applicatin develpment, Platfrm engineering, Data Science Please cntact linkedin.cm/in/randyshup

Managing Data at Scale: Microservices and Events. Randy linkedin.com/in/randyshoup

Managing Data at Scale: Microservices and Events Randy Shoup @randyshoup linkedin.com/in/randyshoup Background VP Engineering at Stitch Fix o Combining Art and Science to revolutionize apparel retail Consulting