Flexible EAI-Lösungen mit Glassfish

Size: px

Start display at page:

Download "Flexible EAI-Lösungen mit Glassfish"

Aldous Waters
6 years ago
Views:

1 Flexible EAI-Lösungen mit Glassfish Praxisbeispiele und War Stories zu EAI-Pattern Alexander Martin We take care of it - personally!

3 EAI Pattern in 2013?

4 EAI Pattern in 2013? Nobody does that anymore!

5 That s THE problem!

6 Integration is ubiquitous Multitude of potential service consumers CRM Application

7 Integration is ubiquitous Multitude of potential service consumers ERP Application CRM Application

8 Integration is ubiquitous Multitude of potential service consumers? CRM Application

9 Integration is ubiquitous Multitude of potential service consumers CRM Application

10 Patterns? Wasn t there a book?

11 Patterns? Wasn t there a book? Design Patterns (Gamma et al), 1994

12 Patterns? Wasn t there a book? Design Patterns (Gamma et al), 1994 Proven solutions for common problems

13 Patterns? Wasn t there a book? Design Patterns (Gamma et al), 1994 Proven solutions for common problems Enterprise Integration Patterns (Hohpe & Woolf), 2003

14 Patterns? Wasn t there a book? Design Patterns (Gamma et al), 1994 Proven solutions for common problems Enterprise Integration Patterns (Hohpe & Woolf), 2003 Swiss-army knife for asynchronous messaging

15 Patterns? Wasn t there a book? Design Patterns (Gamma et al), 1994 Proven solutions for common problems Enterprise Integration Patterns (Hohpe & Woolf), 2003 Swiss-army knife for asynchronous messaging

16 We all believe that asynchronous messaging carries the greatest promise. - Martin Fowler (Foreword of Enterprise Integration Patterns, 2003)

17 MESSAGING?

18 Benefits of async. Messaging

19 Benefits of async. Messaging decoupled

20 Benefits of async. Messaging decoupled integrated platforms/ languages

21 Benefits of async. Messaging decoupled integrated platforms/ languages reliable communication

22 Benefits of async. Messaging decoupled integrated platforms/ languages reliable communication disconnected

23 Benefits of async. Messaging decoupled integrated platforms/ languages reliable communication disconnected throttled

24 But why those Patterns? We take care of it - personally!

25 Thoughts on EAI patterns

26 Thoughts on EAI patterns not invented, but observed

27 Thoughts on EAI patterns not invented, but observed don t solve everything

28 Thoughts on EAI patterns not invented, but observed don t solve everything provide ideas

29 Thoughts on EAI patterns not invented, but observed don t solve everything provide ideas good ones evolve

30 Thoughts on EAI patterns not invented, but observed don t solve everything provide ideas good ones evolve changes are incorporated at eaipatterns.com

31 Real Life Scenario Simple order management system (CRUD) order management system

32 Real Life Scenario Simple order management system (CRUD) basic Java EE order management system

33 Real Life Scenario Simple order management system (CRUD) basic Java EE Just CRUD operations order management system

34 Real Life Scenario Simple order management system (CRUD) basic Java EE Just CRUD operations information silo order management system

35 Real Life Scenario Simple order management system (CRUD) basic Java EE Just CRUD operations information silo order management system

36 Simple Change order management system

37 Simple Change Enhance the system with an importer! order management system

38 Simple Change Enhance the system with an importer! Receive CSV-data via HTTP POST order management system

39 Simple Change Enhance the system with an importer! Receive CSV-data via HTTP POST CSV contains header and detail records order management system

40 Simple Change Enhance the system with an importer! Receive CSV-data via HTTP POST CSV contains header and detail records Import data into database order management system

41 A Simple Java EE = {"/order/import"}) public class ImporterServlet extends HttpServlet OrderBean CsvDataParser parser; protected void dopost(httpservletrequest request, HttpServletResponse response) throws ServletException, IOException { String data = request.getparameter("csvdata"); List<Order> orders = parser.transform(data); for (Order order : orders) { bean.persist(order); } }

42 Simple Change done Enhanced the system with an importer! System Business Partner csv HTTP Transform order management system

43 Change happens Integrate the system of a forwarder System Business Partner csv REST HTTP Transform order management system FTP SMTP SOAP WSSE forwarder system

44 Recognize an integration task when it s staring in your face?

45 EASY!

46 Build an easy and maintainable solution for multiple integration challenges?

47 NO PROBLEM!

48 Something wrong = {"/order/import"}) public class ImporterServlet extends HttpServlet OrderBean CsvDataParser parser; protected void dopost(httpservletrequest request, HttpServletResponse response) throws ServletException, IOException { String data = request.getparameter("csvdata"); List<Order> orders = parser.transform(data); for (Order order : orders) { bean.persist(order); } }

49 Something wrong = {"/order/import"}) public class ImporterServlet extends HttpServlet OrderBean CsvDataParser parser; testable? protected void dopost(httpservletrequest request, HttpServletResponse response) throws ServletException, IOException { String data = request.getparameter("csvdata"); List<Order> orders = parser.transform(data); for (Order order : orders) { bean.persist(order); } }

50 Something wrong = {"/order/import"}) public class ImporterServlet extends HttpServlet { OrderBean CsvDataParser parser; testable? protected void dopost(httpservletrequest request, HttpServletResponse response) throws ServletException, IOException { String data = request.getparameter("csvdata"); List<Order> orders = parser.transform(data); for (Order order : orders) { bean.persist(order); } }

51 Something wrong = {"/order/import"}) public class ImporterServlet extends HttpServlet { OrderBean CsvDataParser parser; testable? protected void dopost(httpservletrequest request, HttpServletResponse response) throws ServletException, IOException { String data = request.getparameter("csvdata"); List<Order> orders = parser.transform(data); for (Order order : orders) { bean.persist(order); } } extensible?

52 How could we do better?

53 Pipes and Filters

54 Pipes and Filters divide your task into small steps

55 Apply pipes & filters pattern inbound Pipe Route transform Pipe outbound

56 Apply pipes & filters pattern inbound Pipe Route transform Pipe outbound Servlet

57 Apply pipes & filters pattern inbound Pipe Route transform Pipe outbound Servlet Custom

58 Apply pipes & filters pattern inbound Pipe Route transform Pipe outbound Servlet Custom JPA

59 When you got the right tools to do the job?

60 INFALLIBLE!

61 Is there something simpler?

62 Property of ChinBuye Limited. ADAPTERS?

63 EAI Frameworks Apache Camel Spring Integration

64 A simple camel route from("jetty: orderimport ).process(new PostParameterProcessor( csvdata )).process(new StringRemover(new String[]{"\""})).unmarshal().csv().split(body(List.class)).aggregate(header("orderId"), new MySpecialAggregationStrategy()).completionTimeout(3000).to("seda:singlepartsroute");

65 Spring Integration sample <int- id="orderimporthttpadapter"! path="/order/import supported-methods="post"! channel="ordersin"/> <int:channel="ordersin"/> <int:splitter input-channel="ordersin" ref="ordersplitter" method="split" output-channel="orderstodb" /> <bean id="ordersplitter" class="com.innoq.samples.eai.ordersplitter"/> <int:channel="orderstodb"/> <int-jpa:updating-outbound-gateway request-channel="orderstodb" entity-class="com.innoq.samples.eai.domain.order" entity-manager="em"/>

66 Configuration in XML?

67 Configuration in XML?

68 Real-life scenario: Control Bus Embedded Jetty Tomcat EAI-Node EAI-Node EAI-Node ctrl-queue OracleDB + AQ xml-route-config Admin UI

69 Real-life scenario: Control Bus Initial Node configuration database connection node type (command line arg) EAI-Node EAI-Node EAI-Node ctrl-queue OracleDB + AQ xml-route-config Admin UI

70 Real-life scenario: Control Bus 1. Server startup subscribe to control queue EAI-Node EAI-Node EAI-Node ctrl-queue OracleDB + AQ xml-route-config Admin UI

71 Real-life scenario: Control Bus 1. Server startup subscribe to control queue load node-type specific config EAI-Node EAI-Node EAI-Node ctrl-queue OracleDB + AQ xml-route-config Admin UI

72 Config 2. during runtime route config is changed EAI-Node EAI-Node EAI-Node ctrl-queue OracleDB + AQ xml-route-config Admin UI

73 Config 2. during runtime route config is changed publish config update message EAI-Node EAI-Node EAI-Node ctrl-queue OracleDB + AQ xml-route-config Admin UI

74 Config 3. upon control message arrival interpret relevance of control message EAI-Node EAI-Node EAI-Node ctrl-queue OracleDB + AQ xml-route-config Admin UI

75 Config 3. upon control message arrival interpret relevance of control message affected nodes reload configuration EAI-Node EAI-Node EAI-Node ctrl-queue OracleDB + AQ xml-route-config Admin UI

76 What would we change today? GlassFish 4.0 EAI-Node EAI-Node EAI-Node ctrl-queue OracleDB + AQ xml-route-config Admin UI

77 More EAI-Patterns in the wild

78 Message Router

79 Message Router forward by condition

80 Message Router

81 Message Router from( ibmmq:queue.in ).noautostartup().transacted().policy(required).routeid(basicroutebuilder.stdfromrouteid(this.componentbasename)).process(vslheadersprocessor).setheader(hdr_dummycomplchk_ibr, constant(passedmsg)).bean(inboundtargetdispatcherbean).wiretap("seda:inboundrouter.log"); Apache Camel running in WAS6.1

82 Message Router from( ibmmq:queue.in ).noautostartup().transacted().policy(required).routeid(basicroutebuilder.stdfromrouteid(this.componentbasename)).process(vslheadersprocessor).setheader(hdr_dummycomplchk_ibr, constant(passedmsg)).bean(inboundtargetdispatcherbean).wiretap("seda:inboundrouter.log"); Apache Camel running in WAS6.1

83 Message Router public class InboundTargetMsgDispatcherBean implements Constants { /** * Map for all eligible Target Endpoints of the InboundRouter. */ private final Map<String, String[]> alltargets = new HashMap<String, public String[] route(@header(hdr_jmsx_groupid) String group) { String[] t = alltargets.get(group); return t; } /** * creates valid endpoint-uris from targetjmsuri and numbering. */ private void createalltargets() { if (alltargets.keyset().size() == 0) { for (int i = 0; i < NROFROUTES; i++) { String target = createtargetjmsuri(i); alltargets.put(string.valueof(i), new String[] { target }); } } }

84 Transformer

85 Transformation mit BPMN-System (1)

86 Transformation für BPMN-System (2) from( ).routeid("bankapp.transformation.dispatch." + identification).choice().when().xpath("//v10:*[1]", inputns).to("direct:transform_v10_v11 ).otherwise().to(outputendpoint).endchoice();

87 Transformation für BPMN-System (2) from( ).routeid("bankapp.transformation.dispatch." + identification).choice().when().xpath("//v10:*[1]", inputns).to("direct:transform_v10_v11 ).otherwise().to( + BPMNSystemSpecEP?bridgeEndpoint=true ).endchoice();

Transformation für BPMN-System (2) from( http://localhost:8080/authservice/proxy/transformed?bridgeendpoint=true ).routeid("bankapp.transformation.dispatch." + identification).

88 Transformation für BPMN-System (2) from( ).routeid("bankapp.transformation.dispatch." + identification).choice().when().xpath("//v10:*[1]", inputns).to("direct:transform_v10_v11 ).otherwise().to( + BPMNSystemSpecEP?bridgeEndpoint=true ).endchoice();

89 Transformation für BPMN-System (2) from( ).routeid("bankapp.transformation.dispatch." + identification).choice().when().xpath("//v10:*[1]", inputns).to("direct:transform_v10_v11 ).otherwise().to( + BPMNSystemSpecEP?bridgeEndpoint=true ).endchoice();

90 Transformation für BPMN-System (3) from( direct:transform_v10_v11 ).routeid("projectx.route.transformation.transform.v10_v11 ).setbody().xpath("/s:envelope/s:body/*[1]", soapns).to("xslt:xsl/bankx/bank_v10_v11.xsl").bean(xbanktransformerbean, "transform_v10_v11").setbody().simple(transformationconstants.soapstart +"$ {in.body}"+transformationconstants.soapend).process(new ContentPrinter("v10-v11 )).inout( + bridgeendpoint=true ).to("direct:response" + reverseidentification);

91 Transformation für BPMN-System (3) from( direct:transform_v10_v11 ).routeid("projectx.route.transformation.transform.v10_v11 ).setbody().xpath("/s:envelope/s:body/*[1]", soapns).to("xslt:xsl/bankx/bank_v10_v11.xsl").bean(xbanktransformerbean, "transform_v10_v11").setbody().simple(transformationconstants.soapstart +"$ {in.body}"+transformationconstants.soapend).process(new ContentPrinter("v10-v11 )).inout(outputendpoint).to("direct:response" + reverseidentification);

92 Transformation für BPMN-System (3) from( direct:transform_v10_v11 ).routeid("projectx.route.transformation.transform.v10_v11 ).setbody().xpath("/s:envelope/s:body/*[1]", soapns).to("xslt:xsl/bankx/bank_v10_v11.xsl").bean(xbanktransformerbean, "transform_v10_v11").setbody().simple(transformationconstants.soapstart +"$ {in.body}"+transformationconstants.soapend).process(new ContentPrinter("v10-v11 )).inout(outputendpoint).to("direct:response" + reverseidentification);

93 Transformation für BPMN-System (3) from( direct:transform_v10_v11 ).routeid("projectx.route.transformation.transform.v10_v11 ).setbody().xpath("/s:envelope/s:body/*[1]", soapns).to("xslt:xsl/bankx/bank_v10_v11.xsl").bean(xbanktransformerbean, "transform_v10_v11").setbody().simple(transformationconstants.soapstart +"$ {in.body}"+transformationconstants.soapend).process(new ContentPrinter("v10-v11 )).inout(outputendpoint).to("direct:response" + reverseidentification);

94 Transformation für BPMN-System (3) from("direct:transform_v10_v11").routeid("projectx.route.transformation.transform." + identification).setbody().xpath("/s:envelope/s:body/*[1]", soapns).to("xslt:xsl/bankx/bank_" + identification + ".xsl").bean(transformerbean, "transform_v10_v11")... public class BankTransformerBean extends AbstractTransformerBean "rawtypes" }) public String transform_v10_v11(@body String body) throws JDOMException, IOException { Element message = parse(body); message.removenamespacedeclaration(nsxbank_v1_0); message.removenamespacedeclaration(nsybank_v1_0); message.addnamespacedeclaration(nsxbankv1_1);... return tostring(message); "rawtypes" }) public String transform_v11_v10(@body String body) throws JDOMException, IOException {

95 Transformation für BPMN-System (3) from( direct:transform_v10_v11 ).routeid("projectx.route.transformation.transform.v10_v11 ).setbody().xpath("/s:envelope/s:body/*[1]", soapns).to("xslt:xsl/bankx/bank_v10_v11.xsl").bean(xbanktransformerbean, "transform_v10_v11").setbody().simple(transformationconstants.soapstart +"$ {in.body}"+transformationconstants.soapend).process(new ContentPrinter("v10-v11 )).inout( + bridgeendpoint=true ).to("direct:response_v11_v10 );

96 Transformation für BPMN-System (3) from( direct:transform_v10_v11 ).routeid("projectx.route.transformation.transform.v10_v11 ).setbody().xpath("/s:envelope/s:body/*[1]", soapns).to("xslt:xsl/bankx/bank_v10_v11.xsl").bean(xbanktransformerbean, "transform_v10_v11").setbody().simple(transformationconstants.soapstart +"$ {in.body}"+transformationconstants.soapend).process(new ContentPrinter("v10-v11 )).inout( + bridgeendpoint=true ).to("direct:response_v11_v10 );

$xsl").bean(transformerbean, "transform_v11_v10").setbody().simple(transformationconstants.soapstarttixbank +"${in.body}" +TransformationConstants.$

97 Transformation für BPMN-System (4) from("direct:response_v11_v10 ).setbody().xpath("/s:envelope/s:body/*[1]", soapns).to("xslt:xsl/bankx/bank_v11_v10.xsl").bean(transformerbean, "transform_v11_v10").setbody().simple(transformationconstants.soapstarttixbank +"${in.body}" +TransformationConstants.soapEnd);

98 Flexibility through Filters inbound Pipe Route filter Pipe outbound Filters are exchangeable, reusable and easily testable

100 Should I always use an EAI-Framework?

101 Should I always use an EAI-Framework? It depends!

102 Further tips considering EAI

103 Further tips considering EAI small building blocks

104 Further tips considering EAI small building blocks no shared mutable state

105 Further tips considering EAI small building blocks no shared mutable state use immutable DTOs

106 Further tips considering EAI small building blocks no shared mutable state use immutable DTOs => increased scalability

107 Further tips considering EAI small building blocks no shared mutable state use immutable DTOs => increased scalability advanced: see SEDA & actor model

108 Vielen Dank! Alexander Martin We take care of it - personally!

EAI War Stories. ! Alexander Martin Praxisbeispiele zu EAI-Pattern und Lessons Learned

EAI War Stories. ! Alexander Martin Praxisbeispiele zu EAI-Pattern und Lessons Learned EAI War Stories Praxisbeispiele zu EAI-Pattern und Lessons Learned! Alexander Heusingfeld, @goldstift Martin Huber, @waterback We take care of it - personally! EAI Pattern in 2013? Nobody uses them anymore!