Microservices. Are your Frameworks ready? Martin Eigenbrodt Alexander Heusingfeld

Transcription

1 Microservices Are your Frameworks ready? Martin Eigenbrodt Alexander Heusingfeld

2 Microservices?

3 Levels of Architecture

4

5 Domain architecture

6 Macro (technical) architecture Domain architecture

7 JRuby C# Scala Groovy Java Clojure

8 RDBMS NoSQL K/V RDBMS RDBMS/DWH NoSQL DocDB

9 RDBMS NoSQL K/V RDBMS RDBMS/DWH NoSQL DocDB Micro architecture

10 Challenges

11

12 Challenges

13 Challenges > many services to take care of

14 Challenges > many services to take care of > distributed system

15 Challenges > distributed configuration > service registration & discovery > resilience > fast, automated deployment > metrics

16 Macro- vs. Micro Architecture

17 Frameworks

18 Dropwizard

19 Dropwizard > Glue Code for well known libraries > Java

20 Dropwizard libraries

21 > Jetty Dropwizard libraries

22 Dropwizard libraries > Jetty > Jersey

23 Dropwizard libraries > Jetty > Jersey > Metrics

24 Dropwizard libraries > Jetty > Jersey > Metrics > Jackson > Guava > Logback > Hibernate Validator > Apache Http Client > JDBI > Liquibase > Freemarker & Mustache > Joda

25 Spring Boot and Spring Cloud

26 Spring Boot

27 Spring Boot > convention over configuration approach

28 Spring Boot > convention over configuration approach > Java, Groovy or Scala

29 Spring Boot > convention over configuration approach > Java, Groovy or Scala > self-contained jar or war

30 Spring Boot > convention over configuration approach > Java, Groovy or Scala > self-contained jar or war > tackles dependency-hell via pre-packaging

31 Spring Cloud

32 Spring Cloud > umbrella project for cloud connectors

33 Spring Cloud > umbrella project for cloud connectors > On top of Spring Boot

34 Spring Cloud > umbrella project for cloud connectors > On top of Spring Boot > config server for distributed configuration

35 Spring Cloud > umbrella project for cloud connectors > On top of Spring Boot > config server for distributed configuration > annotations for service-discovery & resilience

36 Play 2

37 Play 2 > Java or Scala > based on Akka > strong async support

38 Configuration

39 Play - Typesafe Config

40 Play - Typesafe Config > Config Library used by akka, play and other

41 Play - Typesafe Config > Config Library used by akka, play and other > HOCON - JSON Data Model + syntactic sugar

42 Play - Typesafe Config > Config Library used by akka, play and other > HOCON - JSON Data Model + syntactic sugar > override via system property

43 Play - Typesafe Config > Config Library used by akka, play and other > HOCON - JSON Data Model + syntactic sugar > override via system property > rich merge and include possibilities

44 public class OrderApp { public static void main(string[] args) { SpringApplication.run(OrderApp.class, args); } }

45 public class OrderApp { public static void main(string[] args) { SpringApplication.run(OrderApp.class, args); } }

46 public class OrderApp { public static void main(string[] args) { SpringApplication.run(OrderApp.class, args); } } > HTTP resource /autoconfig shows all properties

47 public class OrderApp { public static void main(string[] args) { SpringApplication.run(OrderApp.class, args); } } > HTTP resource /autoconfig shows all properties > overwrite via application.properties or CLI parameter

48 public class OrderApp { public static void main(string[] args) { SpringApplication.run(OrderApp.class, args); } } > HTTP resource /autoconfig shows all properties > overwrite via application.properties or CLI parameter > configuration in git? -> Check spring-cloud configserver

49 Http Client

50 Dropwizard public Product resolveproduct(string url) { Product product = client.resource(url).accept(mediatype.application_json).get(product.class); return product; }

51 Spring Boot public Product resolveproduct(string url) { return resttemplate.getforentity(url, Product.class); }

52 Play WS.url(apiUrl).get.map { response => response.json.as[list[bestseller]] }.recover { case e => List() }

53 Service Discovery

54 Service Discovery Service Registry 1. register service ("myself") & heartbeat 2. discover service instances Service Service Service 3. call service instance Client

55 @EnableDiscoveryClient public class OrdersApp { public static void main(string[] args) { SpringApplication.run(OrdersApp.class, args); } }

56 @EnableDiscoveryClient public class OrdersApp { public static void main(string[] args) { SpringApplication.run(OrdersApp.class, args); } }

57 @EnableDiscoveryClient public class OrdersApp { public static void main(string[] args) { SpringApplication.run(OrdersApp.class, args); } }

58 Service Discovery with Sidecar Service Registry 2. register service ("myself") & heartbeat 4. discover service instances Sidecar Service 5. call service instance Sidecar 3. Client 1. health check

59 Resilience

60 Resilience > isolate Failure > apply graceful degradation > be responsive in case of failure

61 Request closed service

62 Request closed service Request open service

63 Request closed service Request open service Request half- open service

64 > Provides Command-oriented Integration of Services > Introduces Circuit Breaker, Bulkheads and Isolation > Decouples from Service-dependencies > Provides metrics-facility to protect from failures

65 Hystrix & Dropwizard public class CommandInDropwizard extends TenacityCommand<Product> protected Product run() throws Exception { Product product = client.resource(url).accept(mediatype.application_json).get(product.class); return product; } } protected Product getfallback() { return FALLBACK_PRODUCT }

66 Hystrix & Dropwizard public class CommandInDropwizard extends TenacityCommand<Product> protected Product run() throws Exception { Product product = client.resource(url).accept(mediatype.application_json).get(product.class); return product; } } protected Product getfallback() { return FALLBACK_PRODUCT }

67 Hystrix & Dropwizard public class CommandInDropwizard extends TenacityCommand<Product> protected Product run() throws Exception { Product product = client.resource(url).accept(mediatype.application_json).get(product.class); return product; } } protected Product getfallback() { return FALLBACK_PRODUCT }

68 Hystrix & Dropwizard public class CommandInDropwizard extends TenacityCommand<Product> protected Product run() throws Exception { Product product = client.resource(url).accept(mediatype.application_json).get(product.class); return product; } } protected Product getfallback() { return FALLBACK_PRODUCT }

69 Hystrix & Dropwizard ResolveProductCommand command = new ResolveProductCommand(client, url); Product product = command.execute();

70 Spring Cloud = fallbackproduct") private Pair<String, ResponseEntity<Product>> resolveproduct(string producturi) { final RestTemplate resttemplate = new RestTemplate(); return new Pair(productUri, resttemplate.getforentity(producturi, Product.class)); } private Pair<String, ResponseEntity<Product>> fallbackproduct(string producturi) { final Product product = new Product(productUri, null, BigDecimal.ZERO); final ResponseEntity<Product> response = new ResponseEntity<Product>(product, PARTIAL_CONTENT); return new Pair(productUri, response); }

71 Spring Cloud Hystrix auto-wrapped with = fallbackproduct") private Pair<String, ResponseEntity<Product>> resolveproduct(string producturi) { final RestTemplate resttemplate = new RestTemplate(); return new Pair(productUri, resttemplate.getforentity(producturi, Product.class)); } private Pair<String, ResponseEntity<Product>> fallbackproduct(string producturi) { final Product product = new Product(productUri, null, BigDecimal.ZERO); final ResponseEntity<Product> response = new ResponseEntity<Product>(product, PARTIAL_CONTENT); return new Pair(productUri, response); }

72 Spring Cloud = fallbackproduct") private Pair<String, ResponseEntity<Product>> resolveproduct(string producturi) { final RestTemplate resttemplate = new RestTemplate(); return new Pair(productUri, resttemplate.getforentity(producturi, Product.class)); } private Pair<String, ResponseEntity<Product>> fallbackproduct(string producturi) { final Product product = new Product(productUri, null, BigDecimal.ZERO); final ResponseEntity<Product> response = new ResponseEntity<Product>(product, PARTIAL_CONTENT); return new Pair(productUri, response); }

73 Spring Cloud = fallbackproduct") private Pair<String, ResponseEntity<Product>> resolveproduct(string producturi) { final RestTemplate resttemplate = new RestTemplate(); return new Pair(productUri, resttemplate.getforentity(producturi, Product.class)); } private Pair<String, ResponseEntity<Product>> fallbackproduct(string producturi) { final Product product = new Product(productUri, null, BigDecimal.ZERO); final ResponseEntity<Product> response = new ResponseEntity<Product>(product, PARTIAL_CONTENT); return new Pair(productUri, response); }

74 Spring Cloud Hystrix method = fallbackproduct") private Pair<String, ResponseEntity<Product>> resolveproduct(string producturi) { final RestTemplate resttemplate = new RestTemplate(); return new Pair(productUri, resttemplate.getforentity(producturi, Product.class)); } private Pair<String, ResponseEntity<Product>> fallbackproduct(string producturi) { final Product product = new Product(productUri, null, BigDecimal.ZERO); final ResponseEntity<Product> response = new ResponseEntity<Product>(product, PARTIAL_CONTENT); return new Pair(productUri, response); }

75 Play - Circuit Breaker val apiurl = "..." val breaker = CircuitBreaker(Akka.system().scheduler, maxfailures = 5, calltimeout = 2.seconds, resettimeout = 1.minute) def getbestseller : Future[List[Bestseller]] = { breaker.withcircuitbreaker( WS.url(apiUrl).get.map { response => response.json.as[list[bestseller]] }).recover { case e => List() } }

76 Play - Circuit Breaker val apiurl = "..." val breaker = CircuitBreaker(Akka.system().scheduler, maxfailures = 5, calltimeout = 2.seconds, resettimeout = 1.minute) def getbestseller : Future[List[Bestseller]] = { breaker.withcircuitbreaker( WS.url(apiUrl).get.map { response => response.json.as[list[bestseller]] }).recover { case e => List() } }

77 Play - Circuit Breaker val apiurl = "..." val breaker = CircuitBreaker(Akka.system().scheduler, maxfailures = 5, calltimeout = 2.seconds, resettimeout = 1.minute) def getbestseller : Future[List[Bestseller]] = { breaker.withcircuitbreaker( WS.url(apiUrl).get.map { response => response.json.as[list[bestseller]] }).recover { case e => List() } }

78 Play - Circuit Breaker val apiurl = "..." val breaker = CircuitBreaker(Akka.system().scheduler, maxfailures = 5, calltimeout = 2.seconds, resettimeout = 1.minute) def getbestseller : Future[List[Bestseller]] = { breaker.withcircuitbreaker( WS.url(apiUrl).get.map { response => response.json.as[list[bestseller]] }).recover { case e => List() } }

79 Play - Circuit Breaker val apiurl = "..." val breaker = CircuitBreaker(Akka.system().scheduler, maxfailures = 5, calltimeout = 2.seconds, resettimeout = 1.minute) def getbestseller : Future[List[Bestseller]] = { breaker.withcircuitbreaker( WS.url(apiUrl).get.map { response => response.json.as[list[bestseller]] }).recover { case e => List() } }

80 Deployment

81 Spring Boot - Packaging./gradlew build./gradlew distzip

82 Spring Boot - Packaging executable JAR./gradlew build./gradlew distzip

83 Spring Boot - Packaging executable JAR./gradlew build./gradlew distzip ZIP + shell-script

84 Play - Packaging sbt dist sbt debian:packagebin sbt rpm:packagebin

85 Metrics

86 Dropwizard > Metrics Integrated with Dropwizard on Resources > HTTP Client is already instrumented > JVM Data

87 "org.apache.http.client.httpclient.cart.get-requests": { "count": 11, "max": , "mean": , "min": , "p50": , "p75": , "p95": , "p98": , "p99": , "p999": , "stddev": , "m15_rate": 0, "m1_rate": 0, "m5_rate": 0, "mean_rate": , "duration_units": "seconds", "rate_units": "calls/second" } "cart.resources.shoppingcartresource.shoppingcart": { "count": 22, "max": , "mean": , "min": , "p50": , "p75": , "p95": , "p98": , "p99": , "p999": , "stddev": , "m15_rate": , "m1_rate": , "m5_rate": , "mean_rate": , "duration_units": "seconds", "rate_units": "calls/second" }

88 Dropwizard Metrics > Exposed over HTTP (as Json) > Exposed as jmx > Others available: stdout, csv, slf4j, ganglia, graphite

89 Spring Boot Metrics > Prepackaged Spring Boot starter module > enables HTTP resources for metrics > configurable via application.properties

90 Spring Boot Metrics Using a counter metric in your Java code counterservice.increment("checkouts.withproducts." + producturis.size()); will display it in the /metrics JSON GET /metrics HTTP/1.1 { } "counter.checkouts.withproducts.3": 4,...

91 Summary

92 Summary Modularize into independent, self-contained systems

93 Summary Modularize into independent, self-contained systems Separate micro and macro architectures

94 Summary Modularize into independent, self-contained systems Separate micro and macro architectures Strike a balance between control and decentralization

95 Summary Modularize into independent, self-contained systems Separate micro and macro architectures Strike a balance between control and decentralization MicroServices aren t micro!

96 Summary Modularize into independent, self-contained systems Separate micro and macro architectures Strike a balance between control and decentralization MicroServices aren t micro! frameworks can t solve all your problems

97 Thank you! Questions? Comments? Martin Alexander innoq Deutschland GmbH innoq Schweiz GmbH Krischerstr. 100 Ohlauer Straße 43 Robert-Bosch-Straße 7 Radlkoferstraße 2 Gewerbestr Monheim am Rhein Berlin Darmstadt D München CH-6330 Cham Germany Phone: Germany Phone: Germany Phone: Germany Telefon +49 (0) Switzerland Phone: