Agenda. About Me JDriven The case : Westy Tracking Background Architecture Implementation Demo

Transcription

1 y t s e W g n i k c a r T and l a v a j # 6 1 h c r 8 Ma

2 Agenda About Me JDriven The case : Westy Tracking Background Architecture Implementation Demo

3 About me Proud dad of two kids and a '82 VW Westy T3 Joker Founder and managing partner of JDriven Love to code, solder and surf

4 About JDriven 30+ highly skilled colleagues who love to code Specialized in all aspects of enterprise development on the JVM and within the browser Key players in projects of top 100 organization in the Netherlands as developer, architect, advisor and coach Organization focused on optimizing personal growth

5 Before we start We only have 35 minutes left

6 Westy Tracking + = Westy Tracking Platform Show actual details Show trip details Plot actual position & trip on map

7 Westy Tracking : Tracker Specifications GSM Quad-band Frequency GPS chipset Realtime tracking by SMS/GPRS Overspeed Alarm, ACC anti-theft alarm, SOS alarm Real-time voice monitoring Two-Way radio calling Built-in backup battery to realize power failure alarm Device lights turn into sleep mode after 5 minutes Cut vehicle oil or circuit using a relay GPRS Protocol Specification available (sort of) $25

8 Tracker Protocol : Westy Tracking Login: D D 06 0D 0A Login reply: EB 47 0D 0A Location: F 12 0B 08 1D 11 2E 10 CF 02 7A C7 EB 0C F 01 CC D 00 1F B D 0A Location reply: F 0D 0A Not that well documented ;) 22º =(22X )X3000=

9 Reactive

10 Classic architecture Sends tracker data [ TCP ] Requests page [ HTTPS ] Data Receiver Tracker Website Receives GPS Data, Shows devices, locations, trips and map Requests data [ JDBC ] Stores data [ JDBC ] Trip Detector Periodically Detects trips Database PostGis Requests and stores data [ JDBC ] Geocoder Requests and stores data [ JDBC ] Periodically reverse geocodes locations Westy Tracker Platform system boundary Requests Geocoding information [ HTTP ]

11 Modern architecture Sends tracker data [ TCP ] Location [ Event ] [ WebSockets (Trip & Location Events) ] Trip Detector Trip [ Event ] [ HTTPS ] Tracker Website Shows devices, locations, trips and map Detects trips Data Receiver Receives GPS Data Location [ Event ] Enriched Location [ Event ] Location Enrich. Enriches locations Location [ Event ] Enrich Location Request [ Event + Response ] Geocoder Store Requests Geocoding information [ HTTP ] Periodically reverse geocodes locations Redis Westy Tracker Platform system boundary

12 Technologies applied

13 Vert.x A lightweight, high performance application platform for the JVM Polyglot Java, JavaScript, Ruby, Python, Groovy, Clojure, Codox, Scala Simple Small core with APIs for async: HTTP/HTTPS, WebSockets, DNS, FileSystem, Scheduling Extensible Lots of additional features available your application platform

14 Vert.x : s Vert.x executable: Single file or class Communicates with other s using the EventBus Multiple Instances of s can be deployed Single-threaded, don t block the event loop (use Worker s instead) import io.vertx.core.abstract; public class Server extends Abstract { public void start() { vertx.createhttpserver().requesthandler(req -> { req.response().putheader("content-type", "text/plain").end("hello from Vert.x!"); }).listen(8080); } }

15 Vert.x : Core UDP, TCP & HTTP clients and servers Shared data - local maps and clustered distributed maps Periodic and delayed actions Handling deployment DNS client File system access The Event bus High availability & Clustering

16 Vert.x : Core : Eventbus Async Message Bus Message payload: Simple, String, Buffers or JSON Custom using codecs Message patterns: Publish / subscribe Point to point Timeout JavaScript Bridge Distributed No guarantees EventBus eb = vertx.eventbus(); // Send a message eventbus.send("javaland.news", "It s awsome!"); // Receive the message eb.consumer("javaland.news", message -> { System.out.println("Update: " + message.body()); });

17 Vert.x : Other extensions Web Routing, SockJS (event bus bridge), templating Data access MongoDB, Redis, JDBC, SQL,... Integration Mail, Stromp, JCA,... Authentication and Authorisation JWT, Shiro, OAuth2,... Services...

18 Vert.x : Upgraded to Vert.x 3 Easier to run, deploy and test Less a container, more embeddable Introduction of Vert.x Web and other extensions Java 8 instead of Groovy It rules!

19 Vert.x : Westy : Overview Tracker s Tracker Tcp Connection Tracker Protocol Tracker Persistence Main Location s Location Enriching Reverse Geocoding GeoHash Location Persistence Trip s Web Trip Detection Trip Persistence

20 Vert.x : Westy : Tracker Tcp Connection Tracker s Tracker Tcp Connection Tracker Protocol Tracker Persistence Main Location s Location Enriching Reverse Geocoding GeoHash Location Persistence Trip s Web Trip Detection Trip Persistence

21 Vert.x : Westy : Tracker Tcp Connection public class TrackerTcpConnection extends Abstract { public void start() throws Exception { vertx.createnetserver().connecthandler(connection -> { String socketid = connection.writehandlerid(); connection.handler(buffer -> { JsonObject messagebody = createmessagebody(socketid, buffer); vertx.eventbus().publish("tracker.tcp.in", messagebody); }); }).listen(port, host); } }

22 Vert.x : Westy : Location Enriching Tracker s Tracker Tcp Connection Tracker Protocol Tracker Persistence Main Location s Location Enriching Reverse Geocoding GeoHash Location Persistence Trip s Web Trip Detection Trip Persistence

23 Vert.x : Westy : Location Enriching vertx.eventbus().consumer("tracker.location", message -> {... Future<JsonObject> geohashfuture = Future.future(); Future<JsonObject> reversegeocodingfuture = Future.future(); vertx.eventbus().send("tracker.location.geohash", message.body(), geohashresult -> { if (geohashresult.succeeded()) { geohashfuture.complete((jsonobject) geohashresult.result().body()); } else { geohashfuture.fail(geohashresult.cause()); } }); DeliveryOptions deliveryoptions = new DeliveryOptions().setSendTimeout(TIMEOUT); vertx.eventbus().send("tracker.location.reversegeocode", message.body(), options, rgresult -> { if (rgresult.succeeded()) { reversegeocodingfuture.complete((jsonobject) rgresult.result().body()); } else { reversegeocodingfuture.fail(rgresult.cause()); } }); });

24 Vert.x : Westy : Location Enriching (2) CompositeFuture.all(geoHashFuture, reversegeocodingfuture).sethandler(combinedresult -> { JsonObject enrichedpayload = ((JsonObject)message.body()).copy(); if (geohashfuture.succeeded()) { enrichedpayload.put("geohash", geohashfuture.result().getstring("geohash")); if (reversegeocodingfuture.succeeded()) { enrichedpayload.put("location", reversegeocodingfuture.result()); } else { logger.warn("reversegeocode failed, continue without", reversegeocodingfuture.cause()); } vertx.eventbus().publish("tracker.location.enriched", enrichedpayload); } });

25 Redis : Key Features Key-value cache and store Optional persistence to disk More a data structure server, the value can contain different types It also supports transactions, publish / subscribe and Time-to-Live Clients available for virtually every language

26 Redis : Data Types String List Collections of string elements sorted according to the order of insertion. Set Collections of unique, unsorted string elements. Sorted Set Similar to Sets but where every string element is associated to a floating number value, called score. Hash Maps composed of fields associated with values. Both the field and the value are strings.

27 Redis : Data Types : String > SET hello westy OK > GET hello "westy"

28 Redis : Data Types : List > LPUSH mylist T # Push at head (integer) 1 > LPUSH mylist S E W # Push multiple at head (integer) 4 > RPUSH mylist Y (integer) 5 > LRANGE mylist 0-1 1) "W" 2) "E" 3) "S" 4) "T" 5) "Y" # Push at tail

29 Redis : Data Types : Set > SADD myset M Y W E S T Y (integer) 6 > SMEMBERS myset 1) "M" 2) "Y" 3) "E" 4) "T" 5) "S" 6) "W"

30 Redis : Data Types : Sorted Set > ZADD transporter:types 1990 "VW T4" (integer) 1 > ZADD transporter:types 1950 "VW T1" (integer) 1 > ZADD transporter:types 1979 "VM T3" (integer) 1 > ZADD transporter:types 1967 "VW T2" (integer) 1 > ZRANGE transporter:types 0-1 1) "VW T1" 2) "VW T2" 3) "VM T3" 4) "VW T4"

31 Redis : Data Types : Hash > HMSET vw:1000 license aa-bb-cc buildyear 1977 verified 1 OK > HGET vw:1000 license "aa-bb-cc" > HGET vw:1000 buildyear "1977" > HGETALL vw:1000 1) "license" 2) "aa-bb-cc" 3) "buildyear" 4) "1977" 5) "verified" 6) "1"

32 Redis : Westy : Include Redis Dependency (Gradle) compile "io.vertx:vertx-redis-client:${vertx.version}" Initialization () RedisOptions redisoptions = new RedisOptions(config().getJsonObject("redis")); redisclient = RedisClient.create(vertx, redisoptions); Configuration (platform.json) { "redis": { "address": "spotwatch.redis", "host": "redis", "port": 6379, "encoding": "UTF-8" } }

33 Redis : Westy : Store location details vertx.eventbus().consumer("tracker.location.enriched", message -> { JsonObject messagebody = (JsonObject) message.body(); Long receivedat = messagebody.getlong("receivedat"); String deviceid = messagebody.getstring("deviceid"); // Store location information at tracker:<deviceid>:location:receivedat redisclient.zadd(gettrackerlocationskey(deviceid), receivedat, messagebody.encode(), result -> { message.reply(result.result()); }); // Store received at tracker:<deviceid>:location:geohash using the geohash as key redisclient.hset( gettrackerlocationsgeohashkey(deviceid), messagebody.getstring("geohash"), String.valueOf(receivedAt), result -> { message.reply(result.result()); } ); });

34 AngularJS : Key Features Declarative HTML approach Two way Data Binding MVC/MVVM Design Pattern Dependency Injection Routing Reusable Components: Modules, Services, Directives, Built-in end to end Integration Testing / Unit Testing

35 AngularJS : Westy : Web public class Web extends Abstract { public void start() throws Exception { Router router = Router.router(vertx); router.route().handler(statichandler.create(webconfig.getstring("webroot"))); SockJSHandler sockjshandler = SockJSHandler.create(vertx, new SockJSHandlerOptions()); PermittedOptions permitted = new PermittedOptions().setAddressRegex("web\\..+"); sockjshandler.bridge(new BridgeOptions().addInboundPermitted(permitted).addOutboundPermitted(permitted) ); router.route("/eventbus/*").handler(sockjshandler); HttpServer server = vertx.createhttpserver(); server.requesthandler(router::accept).listen(port, host); } }

36 AngularJS : Westy : AngularJS angular.module('frontendapp').controller('mainctrl', function (..., vertxeventbusservice) { // Register eventbus system handlers $rootscope.$on('vertx-eventbus.system.connected', function () { console.log('eventbus connected') $scope.connected = true; requestinitialdata(); }); $rootscope.$on('vertx-eventbus.system.disconnected', function () { console.log('eventbus disconnected'); $scope.connected = false; }); var requestinitialdata = function () { vertxeventbusservice.send('web.devices.request').then(function (devicesdata) { _.each(devicesdata, function (device) { $scope.devices[device.id] = device; }); }); }; // Register functionality related handler(s) vertxeventbusservice.on('web.device.location', function (location) { $scope.devicelocations[location.deviceid] = location; });

37 AngularJS : Westy : AngularJS : D3 & Leaflet D3 <nvd3-multi-bar-horizontal-chart data="activespeedgraph" showvalues="true" objectequality="true"> <svg></svg> </nvd3-multi-bar-horizontal-chart> Leaflet <leaflet height="600" center="mapcenter" markers="devicemarkers" paths="trippaths"> </leaflet>

38 Westy : Last remarks Focus on dev and ops experience using specialized tools but fully integrated Gradle build Vert.x is simple if it fit s your needs Vert.x 3 rules, try it! Not everything is reactive, watch the arrows

39 Demo

40 Q&A

41 Thank you for your attention You really should experience