the open source choice for SOA infrastructure Lightweight RESTful Integration with Mule Dan Diephouse

Size: px

Start display at page:

Download "the open source choice for SOA infrastructure Lightweight RESTful Integration with Mule Dan Diephouse"

Osborn Alexander
5 years ago
Views:

1 the open source choice for SOA infrastructure Lightweight RESTful Integration with Mule Dan Diephouse

2 SOA defined All contents Copyright! 2008, MuleSource Inc. 2

3 SOA is dead? All contents Copyright! 2008, MuleSource Inc. 3

4 Website Service Application Library All contents Copyright! 2008, MuleSource Inc. 4

5 Crap to deal with when building services Versioning Coupling Interoperability Scalability Infrastructure All contents Copyright! 2008, MuleSource Inc. 5

6 REST: Loosely coupled All contents Copyright! 2008, MuleSource Inc. 6

7 REST: Interoperability All contents Copyright! 2008, MuleSource Inc. 7

8 REST: Scalability All contents Copyright! 2008, MuleSource Inc. 8

9 !"#$%!&'()#*+,-./+*#0,+#/"")12 All contents Copyright! 2008, MuleSource Inc. 9

10 The magical mystery bus! All contents Copyright! 2008, MuleSource Inc. 10

11 Routing Transactions Transformations ESB Security Messaging Queueing All contents Copyright! 2008, MuleSource Inc. 11

12 Why do developers choose Mule? No prescribed message format 3 XML, CSV, Binary, Streams, Record, Java Objects 3 Mix and match Zero code intrusion 3 Mule does not impose an API on service objects 3 Objects are fully portable Existing objects can be managed 3 POJOs, IoC Objects, EJB Session Beans, Remote Objects 3 REST & Web Services Easy to test 3 Mule can be run easily from a JUnit test case 3 Framework provides a Test compatibility kit 3 Scales down as well as up

13 Mule Manufacturing Co. All contents Copyright! 2008, MuleSource Inc. 13

14 Mule Services Service Inbound Endpoints Component Outbound Routers All contents Copyright! 2008, MuleSource Inc. 14

15 Core Concepts: Connectors HTTP JMS FTP TCP UDP LDAP BPM CXF File POP SMTP Multicast VM XMPP WSDL STDIO All contents Copyright! 2008, MuleSource Inc. 15

16 Core Concepts: Endpoints Used to connect components and external systems together Endpoints use a URI for Addressing Can have transformer, transaction, filter, security and meta-information associated Two types of URI 3 scheme://[username][:password]@[host][:port]?[params]! smtp://ross:pass@localhost:25 3 scheme://[address]?[params]! jms://my.queue?persistent=true

Core Concepts: Routers Control how events are sent and received Can model all routing patterns defined in the EIP Book Inbound Routers 3 Idempotency 3 Selective

17 Core Concepts: Routers Control how events are sent and received Can model all routing patterns defined in the EIP Book Inbound Routers 3 Idempotency 3 Selective Consumers 3 Re-sequencing 3 Message aggregation Outbound Routers 3 Message splitting / Chunking 3 Content-based Routing 3 Broadcasting 3 Rules-based routing 3 Load Balancing

Core Concepts: Transformers Transformers 3 Converts data from one format to another 3 Can be chained together to form transformation pipelines <jms:object-to-jms

18 Core Concepts: Transformers Transformers 3 Converts data from one format to another 3 Can be chained together to form transformation pipelines <jms:object-to-jms name="xmltojms"/> <custom-transformer name="cobolxmltobusxml" class="com.myco.trans.cobolxmltobusxml"/> <endpoint address="jms://trades" transformers="cobolxmltobusxml, XmlToJms"/>

19 Simple example!"#$%&'#()*+#,-.#/0#$%&'#"-1!&)/23)41!&)/23)45#)462&)7(*44$#"",-87769::;2'*;82"79<=>?>-((((((((((( All contents Copyright! 2008, MuleSource Inc. 19

20 Simple example!"#$%&'#()*+#,-.#/0#$%&'#"-1!&)/23)41!&)/23)45#)462&)7(*44$#"",!"#$%%&'()'*+)+), All contents Copyright! 2008, MuleSource Inc. 20

21 BUILDING SERVICES All contents Copyright! 2008, MuleSource Inc. 21

22 Jersey Annotations to expose your classes as a RESTful service Implements the JAX-RS (JSR311) specification Mule connector makes it possible to embed JAX-RS services in Mule All contents Copyright! 2008, MuleSource Inc. 22

23 JG*78K-:8#;;2.2$;4-L 63/;&' ';*"" M#;;2N2$;4O#"23$'# P JQRE JG$243'#I&+#K-7#S7:6;*&)-L 63/;&' 07$&)A("*@M#;;2N2$;4KL(P $#73$) -M#;;2(N2$;4-T U U All contents Copyright! 2008, MuleSource Inc. 23

24 JGF0E JG$243'#"K-*66;&'*7&2):S+;-L((( JD2)"3+#"K-*66;&'*7&2):S+;-L 63/;&' O#"62)"#(6;*'#F$4#$KF$4#$(2$4#$L(P &)7 )3+/#$(,(A#7V#S7F$4#$V3+/#$KLT. WOX(;2'*7&2)(,(3$&X)C2YA#7Z/"2;37#G*78KL Y$#"2;%#K-:2$4#$":- [()3+/#$LT $#73$) O#"62)"#Y!"#$%#&'()!$%*)+, Y/3&;4KLT U All contents Copyright! 2008, MuleSource Inc. 24

25 JQRE JG$243'#"K-*66;&'*7&2):S+;-L JG*78K-:P&4U-L 63/;&' F$4#$(A#7F$4#$KJG*78G*$*+K-&4-L(&)7 &4L(P $#73$) 2$4#$"YA#7K&4LT U All contents Copyright! 2008, MuleSource Inc. 25

26 Simple Service Configuration!"#$%&'#()*+#,!2$4#$O#"23$'#-1!&)/23)41!&)/23)45#)462&)7( ';*"",-2$AY+3;#Y#S*+6;#"Y+CAYF$4#$O#"23$'#-:1!:"#$%&'#1 All contents Copyright! 2008, MuleSource Inc. 26

27 Why Jersey? Very easy to build RESTful services inside Mule Built in serialization support for 3 XML via JAXB 3 JSON 3 Images 3 Easily write your own serializers All contents Copyright! 2008, MuleSource Inc. 27

28 INTEGRATING REST INTO YOUR MESSAGING LAYER All contents Copyright! 2008, MuleSource Inc. 28

29 Process flow POST Order Order Resource HTTP response Internal order processing queue All contents Copyright! 2008, MuleSource Inc. 29

30 !"#$%&'#1.!]55 X"(78&"(*()#.(2$4#$^(XC("2_(&)&7&*7#(78#(/*'`#)4( 6$2'#""&)A(551!C&;7#$&)A5$237#$1!237/23)45#)462&)7(*44$#"",-./0112")!#334"&#"-15!*)45C&;7#$1!$#"7;#793$&57#+6;*7#5C&;7#$( %#$/", $%%#"+:-1)"&#"3-15!#S6$#""&2)5C&;7#$( All contents Copyright! 2008, MuleSource Inc. 30

31 Another example: URI template routing!"#$%&'#()*+#,-.#/0#$%&'#"-1!&)/23)41!&)/23)45#)462&)7(*44$#"",-87769::;2'*;82"79<=>?>-((((((((((( All contents Copyright! 2008, MuleSource Inc. 31

32 Modify messages while filtering!!$#"7;#793$&57#+6;*7#5c&;7#$( 6*77#$),-:2$4#$X4:P"#758#*4#$Y2$4#$X4U-(:1!$#"7;#793$&57#+6;*7#5C&;7#$( All contents Copyright! 2008, MuleSource Inc. 32

33 Order Processing Order processing queue Warehouse availability check Log business events All contents Copyright! 2008, MuleSource Inc. 33

34 Order Processing!"#$%&'#()*+#,-)"&#"6")!#33*+B-5!&)/23)41!&)/23)45#)462&)7(*44$#"",-./0112")!#334"&#"-93C+!;")+)>3:-%">#-5!#S6$#""&2)57$*)"C2$+#$1!$#73$)5*$A3+#)7(#%*;3*72$,-;#$&#"-9#<2"#33*)+:-D#"3#C="#32)+3#-915!:#S6$#""&2)57$*)"C2$+#$1!#S6$#""&2)57$*)"C2$+#$1!$#73$)5*$A3+#)7(#%*;3*72$,-B")).C-9#<2"#33*)+:-2$C()$&=#+%*%C-915!:#S6$#""&2)57$*)"C2$+#$1!:&)/23)45#)462&)71!:&)/23)41( /&+01&+2(3-.-/%&+01&+2(3!:"#$%&'#1 All contents Copyright! 2008, MuleSource Inc. 34

35 Order Processing!"#$%&'#()*+#,-)"&#"6")!#33*+B-5!&)/23)43./%&)/23)41!237/23)41!'8*&)&)A5$237#$1!237/23)45#)462&)7(*44$#"",-./011E$"#;)>3#7#".*!#-15!]55 G2"7(78&"(72(78#(Z72+G3/ #%#)7(;2A(551!237/23)45#)462&)7 All contents Copyright! 2008, MuleSource Inc. 35

36 Warehousing!"#$%&'#()*+#,-E$"#;)>3#7#".*!#-5!&)/23)41!&)/23)45#)462&)7(*44$#"",-./011E$"#;)>3#7#".*!#-15!&)/23)45#)462&)7( 3C+!;")+)>3:!"#$%&11!:&)/23)41!'2+62)#)71!"&)A;#72)52/H#'7(';*"",&'H$"#;)>3#7#".*!#-15!:'2+62)#)71!:"#$%&'#1 All contents Copyright! 2008, MuleSource Inc. 36

37 Its just Java 63/;&' ';*"" N*$#823"#0#$%&'# P. U 63/;&' %2&4 $#a3#"7g*$7"kf$4#$(2$4#$l(p U All contents Copyright! 2008, MuleSource Inc. 37

38 ATOMPUB All contents Copyright! 2008, MuleSource Inc. 38

39 Consider using Atom Publishing Protocol Atom: a format for syndication 3 4+*/,.5+*#6).*7*#"'#,+)07+8#.9'",:07."9;#3 a.k.a. feeds 3 Feeds are composed of entries User Extensible More generic than just blog stuff

40 Atom Publishing Protocol RESTful protocol for building services Create, edit, delete entries in a collection Extensible Protocol 3 Paging extensions 3 GData 3 Opensearch Properly uses HTTP so can be scalable, reliable and secure Service Workspaces Collections Entries < Entry Resource Media Entries < Media Link Entry < Media Resource

41 Why you should use APP for your app Provides ubiquitous elements which have meaning across all contexts You can leverage existing solutions for security 3 HTTP Auth, WSSE, Google Login, XML Sig & Enc Eliminates the need for you to write a lot of server/client code 3 ETags, URLs, etc are all handled for you Integrates seamlessly with non-xml data There are many APP implementations and they are known to work well together

42 Eventing Publish and consume entries which map to events Application level events 3 Exceptions/fault monitoring Business level events 3 A expense over $1000 was registered Use query parameters to narrow down the criteria Works with any client which understands Atom Powerful combination with opensearch

43 Process Order is placed Is order > $10,000 Log to business event Atom store All contents Copyright! 2008, MuleSource Inc. 43

44 Abdera Concepts Atom Abdera Service Provider Workspace WorkspaceManager Collection CollectionAdapter All contents Copyright! 2008, MuleSource Inc. 44

45 CollectionAdapters Write your own Built in CollectionAdapters 3 JCR 3 JDBC 3 Filesystem All contents Copyright! 2008, MuleSource Inc. 45

46 !+3;#9"#$%&'# )*+#,-'3"72+#$0#$%&'#-1!+3;#9&)/23)41!+3;#9&)/23)45#)462&)7(*44$#"",-87769::;2'*;82"79b>>c-( 6$2%&4#$5$#C,!*/4#$*G$2%&4#$-:1!:+3;#9"#$%&'#1 All contents Copyright! 2008, MuleSource Inc. 46

47 !*96$2%&4#$(&4,!*/4#$*G$2%&4#$-1!*9.2$`"6*'#(7&7;#,!4")20-5&'6789:),1!$#C(/#*),!H'$Z4*67#$!%1!:*9.2$`"6*'#1!:*96$2%&4#$1 All contents Copyright! 2008, MuleSource Inc. 47

48 JCR Store!/#*)(&4,-D!"I&$2%#"-9 ';*"",&'$G&#"$=2")%)!)(=3#".#"=$&$2%#"3=D!"=J!"K)((#!%*)+I&$2%#"-9 All contents Copyright! 2008, MuleSource Inc. 48

49 Creating Atom Entries!]55 G2"7(78&"(72(78#(Z72+G3/ #<2"#33*)+:-2$C()$&=2"*!# All contents Copyright! 2008, MuleSource Inc. 49

50 Transformers 63/;&' ';*"" #S7#)4" Z/"7$*'7E$*)"C2$+#$ P JF%#$$&4# 6$27#'7#4 F/H#'7(42E$*)"C2$+K F/H#'7("$'_(07$&)A(#)'24&)AL( 78$2." E$*)"C2$+#$RS'#67&2) P. U U All contents Copyright! 2008, MuleSource Inc. 50

51 Transformers F$4#$(2$4#$,(KF$4#$L("$'T [(2$4#$YA#7G$&'#KL([( -(C$2+(- [(2$4#$YA#7D3"72+#$KLLT [( 2$4#$YA#7G$&'#KL([(-(C$2+(- [( 2$4#$YA#7D3"72+#$KLLT d*7#kllt $#73$) All contents Copyright! 2008, MuleSource Inc. 51

52 XML #.$(>$%)":-B")).C-9 #<2"#33*)+:-V>"+0>>*&0V9T9 All contents Copyright! 2008, MuleSource Inc. 52

53 POLLING VS. MESSAGING All contents Copyright! 2008, MuleSource Inc. 53

54 ETag Header Resources may return an ETag header when it is accessed On subsequent retrieval of the resource, Client sends this ETag header back If the resource has not changed (i.e. the ETag is the same), an empty response with a 304 code is returned Reduces bandwidth/latency

55 ETag Example QRE(:C##4Y*72+ M2"79(...Y*'+#Y'2+. Client MEEG:\Y\(c>>(Fe( <90)$-. RE*A9(-=#?<5f\>5=gb<C//'- D2)7#)75h#)A789(\>f>( Server QRE(:C##4Y*72+ XC5V2)#5I*7'89( -=#?<5f\>5=gb<C//'- M2"79(...Y*'+#Y'2+. MEEG:\Y\(=>f(V27(I24&C&#4 <90)$-. RE*A9(-=#?<5f\>5=gb<C//'-( Client Server

$LastModified Example QRE(:C##4Y*72+ M2"79(...Y*'+#Y'2+. QRE(:C##4Y*72+ XC5I24&C&#450&)'#9( 0*7_(cb(F'7(\bbf( \b9f=9=\(qie M2"79(...Y*'+#Y'2+. Client MEEG:\Y\(c>>(Fe( <90)$-.$

56 LastModified Example QRE(:C##4Y*72+ M2"79(...Y*'+#Y'2+. QRE(:C##4Y*72+ XC5I24&C&#450&)'#9( 0*7_(cb(F'7(\bbf( \b9f=9=\(qie M2"79(...Y*'+#Y'2+. Client MEEG:\Y\(c>>(Fe( <90)$-. h*"75i24&c&#49(0*7_(cb(f'7( \bbf(\b9f=9=\(qie D2)7#)75h#)A789(\>f>( MEEG:\Y\(=>f(V27(I24&C&#4 <90)$-. h*"75i24&c&#49(0*7_(cb(f'7( \bbf(\b9f=9=\(qie D2)7#)75h#)A789(> Server

57 Process Poll warehouse for part updates Have the parts arrived? Update status All contents Copyright! 2008, MuleSource Inc. 57

58 Wiring with XML! ;;&)A5'2))#'72$( )*+#,-6)((*+BZ%%2K)++#!%)"-9 All contents Copyright! 2008, MuleSource Inc. 58

59 Is polling the answer? Example from OSCON: crawled flickr 2.9 million times to get the latest photos of 45,754 users, of which 6,721 of that 45,754 potentially (E)"08+8#0#EF"7"2;

60 Frequent updates are common Flickr Blogs Twitter Business events Presence on IM Stock data

61 Is messaging the answer? Messaging is asynchronous 4"+*9G7#E(7#(98(+#)"08#"9#7F+#*+,-+,#098#7F+#/).+97

62 !"#$%&'"()*+",&-".&Flickr/Friendfeed

63 Lookup service Returns coordinate in sparse array

64 Leaves us with Periodic poll (every minute or so) with a 1KB response (1440 times/day) 6700 GETs for new pictures A GET for every time a user signs up

65 In contrast to 6700 XMPP messages per day 6700 GETs for new pictures Maintenance of new infrastructure

66 Conclusions Services are hard! In the long run, REST helps you Getting away from the edges, Mule can help Abdera, Jersey and Restlet are cool Mule has a bunch of other tools to help you too All contents Copyright! 2008, MuleSource Inc. 66

67 Questions? My Blog: Twitter: dandiep All contents Copyright! 2008, MuleSource Inc. 67

the open source choice for SOA infrastructure Bringing the enterprise to the web with Mule

the open source choice for SOA infrastructure Bringing the enterprise to the web with Mule So RESTful services are cool. All contents Copyright 2008, MuleSource Inc. 2 Challenges Middleware is oriented