A RESTful MicroService for JSON Processing in the Database

Transcription

1

2 A RESTful MicroService for JSON Processing in the Database Kuassi Mensah Director, Product Management Database Server Technologies July 11, 2017

3 Safe Harbor Statement The following is intended to outline our general product direction. It is intended for information purposes only, and may not be incorporated into any contract. It is not a commitment to deliver any material, code, or functionality, and should not be relied upon in making purchasing decisions. The development, release, and timing of any features or functionality described for Oracle s products remains at the sole discretion of Oracle. 3

4 Speaker Bio Director of Product Management at Oracle Java frameworks for the Oracle database (OJVM, JDBC, UCP, App Cont, TG, etc) Hadoop, Spark and Flink integration with the Oracle database JavaScript with Oracle database (Nashorn with JDK, JRE and OJVM) MS CS from the Programming Institute of University of Paris VI (Jussieu) Frequent JavaOne, Oracle Open World, Data Summit, Node Summit, Collaborate/IOUG, RMOUG, BIWA, UKOUG, DOAG, OUGN, BGOUG, OUGF, OTN LAD, OTN APAC. Author: Oracle Database Programming using Java and Web Services Social Confidential Oracle Internal/Restricted/Highly Restricted 4

5 Program Agenda The Evolution of Web Applications Processing JSON in the Database JavaScript MicroService on the Database tier A RESTful JavaScript MicroService 5

6 The Evolution of Web Applications Service-based architecture Death of the monolithic application. The era of microservices Programming models and languages Functional programming, Reactive programming Style trumps languages Data models, formats and persistence RDBMS, XML, JSON, Text, Spatial, Graph, etc Polyglot persistence Cloud Services Storage, Infrastructure, Software, Platform, Containers, etc Confidential Oracle Internal/Restricted/Highly Restricted 6

7 Micro Services Distributed Service-oriented architecture A Web Application may have of up to thousands of microservices Polyglot Isolation between services Loose coupling, communication over simple wire protocols Confidential Oracle Internal/Restricted/Highly Restricted 7

8 Monolithic Shopping Cart Application Source: 8

9 MicroService-based Shopping Cart Application Source: 9

10 Key Benefits of Micro Services Organizational and cultural shift Each microservice is developed, deployed and tested independently "you build, you run it (Amazon) DevOps, Continuous Integration and delivery Team agility, flexibility, scalability, fault tolerance Maintenance: detect failure fast, fail gracefully and recover fast But Increased complexity Network Congestion and latency Confidential Oracle Internal/Restricted/Highly Restricted 10

11 Technology of MicroServices Containers: Docker, LXC, etc Service Registry & Discovery: Zookeeper, Eureka, OSGi, Kubernetes Eventing Distributed Consensus Elastic Infrastructure Messaging Polyglot: language, persistence, etc. Confidential Oracle Internal/Restricted/Highly Restricted 11

12 Polyglot Persistence with Oracle Database The Oracle database furnishes an integrated access to all data models Relational XML JSON Text Graph Spatial Multimedia

13 Program Agenda The Evolution of Web Applications Processing JSON in the Database JavaScript MicroService on the Database tier A RESTful JavaScript MicroService 13

14 Processing JSON in the Database Mission statement Design a service for processing millions of JSON documents stored in a database The service may be implemented in any language The service may be deployed in any tier (mid-tier, database) 14

15 Implementation Choices Confidential Oracle Internal/Restricted/Highly Restricted 15

16 Program Agenda The Evolution of Web Applications Processing JSON in the Database JavaScript MicroService on the Database tier A RESTful JavaScript MicroService 16

17 JavaScript & Java: Top Two Popular Languages

18 JavaScript: a Language, a Platform, an Ecosystem Ubiquitous Tons of libraries, frameworks, and tools Node.js, Angular.js, Backbone.js, React.js,, new frameworks by the day Versatile JavaScript supports all programming models, styles and applications types JavaScript extended thru other Languages

19 JavaScript on the JVM: Nashorn Nashorn engine: replacement for Rhino Preserves investment in Java thru interoperability Calling Javascript from Java Calling Java from JavaScript Built into Java 8

20 Running JavaScript with Nashorn using javax.script // 1) Create an instance of the script engine manager ScriptEngineManager factory = new ScriptEngineManager(); // 2) Create an instance of a Nashorn engine ScriptEngine engine = factory.getenginebyname("javascript"); // 3) initialize your Java resource URL url = Thread.currentThread().getContextClassLoader().getResource(abFilePath); // 4) evaluate the JavaScript code engine.eval(new InputStreamReader(url.openStream())); // 5) invoke the evaluated JavaScript function using invokefunction Invocable invobj = (Invocable) engine; Object selectresult = invobj.invokefunction("selectquery", inputid); 20

21 JavaScript/Nashorn with Oracle Database Mid-tier (Java 8) DB 12.2 (Java 8) NASHORN NASHORN JDBC

22 JavaScript In the Database Why? - Faster, no network latency - Avoid data shipping i.e., processing thousands/millions of JSON documents in RDBMS - Reuse JavaScript code and skills for database modules Many DBMS(es) furnish JavaScript - MongoDb - Cosmos DB (built on DocumentDB) - ForerunnerDB Oracle database 12cR2 OJVM supports Java 8 and Nashorn 22

23 Java VM in Oracle RDBMS (a.k.a. OJVM) Same Isolation and Scalability as Microservice Containers Database Process / Session (PGA) Newspace Oldspace Newspace Oldspace Newspace Oldspace Sessionspace Sessionspace Sessionspace Shared Memory (SGA) JDK8 VM (+ Nashorn) Class Objmems Internspace User Java & JavaScript Classes

24 How to Run JavaScript In the Database 1. Load your JavaScript code in your Schema as Java Resource loadjava v u yourschema hello.js 2. Invoke JavaScript : 3 approaches 1) JavaScript Procedures from SQL or PL/SQL by using dbms_javascript.run SQL: call dbms_javascript.run('hello.js'); PL/SQL: dbms_javascript.run('hello.js'); 2) JavaScript Procedures from Java in the database import oracle.aurora.rdbms.dbmsjavascript; DbmsJavaScript.run("hello.js"); 3) JavaScript Functions: using the standard JSR223 scripting APIs in javax.script 24

25 A JavaScript MicroService for JSON Processing var selectquery = function(id) { var Driver = Packages.oracle.jdbc.OracleDriver; var oracledriver = new Driver(); var url = "jdbc:default:connection:"; // server-side JDBC var query ="SELECT first_name, last_name from employees"; // establish a JDBC connection var connection = oracledriver.defaultconnection(); // prepared statement var preparedstatement = connection.preparestatement(query); // execute Query var resultset = preparedstatement.executequery(); while(resultset.next()) { // Placeholder for parsing & processing JSON // Display results print(resultset.getstring(1) + "== " + resultset.getstring(2) + " " ); } // cleanup objects resultset.close();preparedstatement.close();connection.close(); return output; } 25

26 Invoking JavaScript in the Database with javax.script create or replace and compile java source named "InvokeScript" as mport javax.script.*; import java.net.*; import java.io.*; public class InvokeScript { public static String eval(string inputid) throws Exception { String output = new String(); try { // create a script engine manager ScriptEngineManager factory = new ScriptEngineManager(); // create a JavaScript engine ScriptEngine engine = factory.getenginebyname("javascript"); //read the script as a java resource engine.eval(new InputStreamReader(InvokeScript.class.getResourceAsStream("/select.js"))); Invocable invocable = (Invocable) engine; Object selectresult = invocable.invokefunction("selectquery", inputid); output = selectresult.tostring(); } catch(exception e) { output =e.getmessage(); } return output; } } / Confidential Oracle Internal/Restricted/Highly Restricted 26

27 Invoking JavaScript Functions -- Wrap InvokeScript.eval() as a SQL Funtion CREATE OR REPLACE FUNCTION scripteval(inputid in varchar2) return varchar2 as language java name InvokeScript.eval(java.lang.String) return java.lang.string'; / -- A SQL Procedure for calling scripteval CREATE OR REPLACE PROCEDURE sqldemo(id IN varchar2) IS output varchar2(10000); BEGIN SELECT scripteval(id) INTO output from dual; dbms_output.put_line(output); END; / 27

28 Invoke MicroService via SQL sqlplus ORDSTEST/ORDSTEST SQL> set serveroutput on SQL> call dbms_java.set_output(80000); Call completed. SQL> call sqldemo('100'); JSON { "EmpId" : "100", "FirstName" : "Kuassi", "LastName" : "Mensah", "Job" : "Manager", " " : "kuassi@oracle.com", "Address" : { "City" : "Redwood", "Country" : "US" } } JavaScript MicroService JSON 28

29 Demo Invoking the JavaScript MicroService via SQL Confidential Oracle Internal/Restricted/Highly Restricted 29

30 Program Agenda The Evolution of Web Applications Processing JSON in the Database JavaScript MicroService on the Database tier RESTful JavaScript MicroService 30

31 RESTful JavaScript MicroService JSON REST framework JavaScript MicroService JSON Oracle Confidential Internal/Restricted/Highly Restricted 31

32 Oracle REST Data Services (ORDS) Runs on APEX Gateway, WLS, Tomcat, GlassFish, Jersey Install Oracle REST Data Services EA2 in under 5 minutes Need a USERS tablespace with at least 40MB space Follow the steps in Installation Example - accept defaults - skip APEX Gateway (pick option 2 ) - skip specify passwords for Application Express RESTful Services database users (pick option 2 ) - start in standalone mode (pick option 1 ) 32

33 ORDS Configuration Configure the REST service for invoking JavaScript Microservices the URL is made of workspace + p_base_path + p_pattern begin ords.create_service( p_module_name => 'load.routes', p_base_path => '/load/routes/', p_pattern => 'nashorn/selectbyid/:id', p_source_type => 'plsql/block', p_source => 'begin selectbyid(:id); end; ); commit; end; / 33

34 RESTful MiroService for JSON Processing URI { "EmpId" : "100", "FirstName" : "Kuassi", "LastName" : "Mensah", "Job" : "Manager", " " : "kuassi@oracle.com", "Address" : { "City" : "Redwood", "Country" : "US" } } JSON http(s) Oracle REST Data Services URI Request or HTTP(s) post mapped to SQL request JDBC Connection Pool Db call JavaScript MicroService JSON Oracle Database

35 Demo Invoking the JavaScript MicroService via SQL Confidential Oracle Internal/Restricted/Highly Restricted 35

36 Resources GitHub Oracle Db Examples Nashorn JavaScript in Oracle Database 12c Release 2 REST enable Java or JavaScript in the Database Tim Hall s Oracle REST Data Service (ORDS) articles Oracle Confidential Internal/Restricted/Highly Restricted 36

37 Questions? Confidential Oracle Internal 37

38 38

39