Kevin Madden Chief Software Engineer

Transcription

1 Tom Sawyer Software Build Big Data and Graph Visualization Web Applications with Spring Data and Core Java Kevin Madden Chief Software Engineer

2 Agenda Introduction Products and Technology Tom Sawyer Perspectives Case Study Demonstration Integrated Technologies Questions and Answers

3 Tom Sawyer Software Leading provider of software for building graph and data visualization and analysis applications Flagship product Tom Sawyer Perspectives Full-service data visualization vendor Very deep graph visualization technology practice Headquartered in Berkeley, California Offices in the United States, Australia, Germany, Greece, Latvia, and Mexico Founded 1992 Oracle Partner since 2007

4 Tom Sawyer Perspectives Applications Graph and Data Visualization SDK Graph Database Browser Model-Based Engineering Business Process

5 Graph and Data Visualization Web Applications Network Topology Link Analysis Schematics and Maps Architectures and Models Processes, Flows, and Dependencies

6 PoC Demonstration: The Global Knowledge Graph Global Database of Events, Language, and Tone (GDELT) Every 15 minutes 750 B emotional snapshots 35 TB of data +1.5 B location references

7 Project Requirements Intelligence Analysts need: Interactive search, filter, and navigation User-friendly interface Built-in graph analysis Integrated and synchronized views Infrastructure Build data flow pipeline from relational database to graph database Deploy on a highly secure cloud-based infrastructure Pre-filter terabytes of data based on relevance trajectorymagazine.com/analyzing-cyber-threat

8 Technical Challenges Ingest over 35 TB, updated every 15 minutes Create a data warehouse Store in a highly secure traditional database Migrate data and metadata from relational to graph Commit to a property graph database Automatically generate a synchronized view of: Entities (people, locations, events, etc.) Logical and geospatial data Make it easy for end users to: Visualize different layouts Run graph analytics

9 Spring Framework: Java Object-Graph Mapping (OGM) docs.spring.io/spring/docs/4.3.x/spring-framework-reference/html/overview.html

10 Social Network Analysis

11 Case Study Demonstration Global Knowledge Graph

12 Integrated Oracle Technologies 1. Tom Sawyer Perspectives Graph and Data Visualization 2. Oracle Database 3. Oracle Bare Metal Cloud 4. Oracle Big Data Spatial and Graph NoSQL 5. Oracle PGX (Parallel Graph AnalytiX) 6. Oracle SQL Developer 7. Oracle Data Integrator 8. Oracle Business Intelligence 9. Oracle Fusion Middleware 10. Oracle Java 8 Enterprise Edition 11. Oracle WebLogic Application Server

13 Federated Data Integration

14 Architecture Overview Enterprise Data Sources Federate Data Process Data Interactive Views Model Data Tom Sawyer Perspectives

15 Data-to-View Transformations

16 Detailed Architecture

17 Oracle Bare Metal Cloud Relational Database and Property Graph Database Highly secure and protected environment Scalable cloud infrastructure

18 Graphical Designer Tom Sawyer Perspectives

19 Data Views

20 Advanced Drawing and Layout

21 Analysis Integration Declarative analysis Programmatic analysis

22 Processing Parameterized SQL

23 Schema

24 Data Models

25 Graphical Schema Designer Graph database schema extraction Spring Data bean generation

26 Unified Federated Multisource Schema

27 Cloud Application Bootstrap Tom Sawyer Perspectives Web Application Framework Generator

28 Thank You! Questions? Kevin Madden