BEST PRACTICES FOR DEVELOPING GEOSPATIAL BIG DATA APPS FOR THE CLOUD. Nick Salem - Distinguished Engineer David Tatar - Principal Software Engineer

Transcription

1 BEST PRACTICES FOR DEVELOPING GEOSPATIAL BIG DATA APPS FOR THE CLOUD Nick Salem - Distinguished Engineer David Tatar - Principal Software Engineer

2 SPEAKER BIO NICK SALEM 18 Oracle Certified Professional / Expert / Specialist credentials (DBA, RAC, Performance Tuning, Spatial, Security, DW, SQL & PLSQL Development) with 17 years experience developing enterprise geospatial analytical applications Technical Chair of Oracle Spatial & Graph SIG SPEAKER BIO DAVID TATAR 17 years experience in Web architecture, Java and Oracle database technologies with emphasis on GIS mapping and spatial enterprise applications.

3 AGENDA Neustar Quick Intro Geospatial Analytics in the Cloud - ElementOne Order by Spatial Proximity Switching between Multiple Projections Miscellaneous Best Practice Tips 12c Spatial Vector Acceleration Benchmarks Live Demo

4 ABOUT NEUSTAR NYSE: NSR $964 Million in Revenue Employees 14,000+ Customers 20 Billion Requests Per Day Marketing Services IT/Security Services Data Services SITE & MARKET ANALYSIS CUSTOMER & PROSPECT ANALYSIS MEDIA PLANNING TARGETING CUSTOMER INTERACTION MANAGEMENT

5 NEUSTAR S ELEMENTONE PLATFORM Highly flexible and high performance mapping Rich market and trade area capability Road network / drive time analysis Heat themes GeoRaster images Aerials / terrain map overlays Centralized secure data repository

6 ORDER BY SPATIAL PROXIMITY Rows are stored in Oracle blocks Blocks are stored on disk and in memory Clustering Factor Order of data compared to index Use md.hhencode_by_level function to return a order by value See S&G blog for more details Achieved 20x better performance using a 16M business table Compression, pctfree & sdo_rtr_pctfree

7 SWITCHING BETWEEN MULTIPLE PROJECTIONS On the fly dynamic transformation vs process once and store (see S&G blog) Join user_segments & user_lobs to see space consumption of sdo_ordinates Layer (SRID) M Bytes ZIP Codes (8307) 120 ZIP Codes (3785) no rounding 216 ZIP Codes (3785) round ZIP Codes (3785) round 1 136

8 MISCELLANEOUS BEST PRACTICE TIPS Geometry simplification Minimum vertices needed Topology and geometry relationships Build topologically smart processes Partitioning Query pruning Efficient data management 12c Point-in-Polygon function Does not need spatial index Use on global temp + external tables Parallel enabled

9 12C SPATIAL VECTOR ACCELERATION 300x faster SDO_AGGR_UNION 8x faster SDO_TOUCH 6x faster SDO_WITHIN_DISTANCE 6.5x faster SDO_JOIN 10x faster SDO_CS.TRANSFORM 3x faster SDO_GEOM.RELATE 2.6 faster SDO_GEOM.DISTANCE

10 BUILT FOR THE CLOUD Oracle Database 12c Enterprise Edition Oracle Real Application Clusters Oracle Advanced Security Option Oracle Partitioning Option Oracle Data Guard / RMAN / Flashback Database Oracle Cloud Control Oracle Weblogic 12c

11 ELEMENTONE SECURITY Network and data fine grained access controls Function role based security Login trigger checks Auditing Wallet transparent data encryption Virtual Private Database Object Permissions

12 LIVE DEMO ElementOne in Action

13 The Spatial & Graph SIG User Community The SIG connects and exchanges knowledge via online communities and at conferences and events Chat & Coffee at OOW Join us & chat with other S&G users about your experiences! Bring your own coffee Wednesday at 8:00 am Meet in front of Oracle Bookstore Moscone South Lobby Join us online tinyurl.com/oraclespatialcommu nity LinkedIn, Google+ & IOUG SIG groups

14 Upcoming Events Oracle Spatial Summit at BIWA 2017 Oracle HQ, Redwood Shores, CA Jan. 31-Feb. 2, *Call for speakers now open! Copyright 2015, Oracle and/or its affiliates. All rights reserved. 14