Integrating ArcGIS Geoprocessing and Mapping Capabilities into Office 365

Transcription

1 Integrating ArcGIS Geoprocessing and Mapping Capabilities into Office 365 David Howes, Ph.D. David Howes, LLC, Seattle, WA Eric Sant Open Range Consulting, Park City, UT Jason Pardy Jason Pardy Consulting, Rancho Mirage, CA October 20, 2015 Tweet about this presentation #gispro2015

2

3

4

5

6

7

8

9

10

11 App vs. Add-In An app is a self-contained unit with its own interface (see About Tech page) An add-in can t operate on its own - adds to or extends the capabilities of the host program Note updated Microsoft terminology

12

13 Challenge Integrate the capabilities of Office 365-Excel add-ins ArcGIS Server geoprocessing ArcGIS Online mapping

14 Why?

15

16 Business Case Office 365 is being implemented widely at the enterprise and small business levels Excel/ArcGIS integration offers a powerful platform for what Esri terms GeoEnrichment David Howes, LLC GIS consulting business Tools, processes and supporting infrastructure Clients ranging from small businesses to multinational corporations

17 Business Case: Microsoft Build on existing.net desktop/web development capabilities BizSpark Free access to Microsoft productivity and development tools Azure credits Websites Virtual machines Storage

18 Business Case: Esri Rich history with Esri software use and development Esri Developer Network (EDN) $2,190 per year EDN Annual Subscription with ArcGIS for Desktop Basic Access to ArcGIS Server Workgroup Advanced

19 Business Case: Client Needs

20

21

22

23 General Process 1. Select some records in Excel 2. Send data to ArcGIS Server 3. Do something with it 4. Get some results back 5. Show results in worksheet and on a map

24 Specific Process (1) 1. Select records defining species locations in Excel 2. Send data in JSON format to ArcGIS Server.NET (C#) Server Object Extension (SOE) 3. Run the Spatial Analyst ExtractMultiValuesToPoints tool a. For each point location, get the values from three land cover rasters (shrub, herbaceous, bareground) b. New field added to feature class for each raster

25 Specific Process (2) 4. Read the values from the feature class table 5. Send the raster values in JSON format back to Excel 6. Insert the values into the worksheet next to the point records

26

27 Outbound JSON { } "headers":[ ], ["ID","Long","Lat"] "rows":[ [1, ,46.352], [2, ,46.349] ] tmultivaluessoe/extractmultivalues?datatable={"headers":[["id","long","lat" ]],"rows":[[1, , ],[2, , ]]}&f=pjson

28 Return JSON { } "Result": { "1": { "shrub": "0.208", "herbaceous": "0.335", "bareground": "0.324" }, "2": { "shrub": "0.220", "herbaceous": "0.303", "bareground": "0.155" } }

29 How to Create the Excel Add-in

30

31

32

33

34

35

36

37

38

39

40 Creating the Excel Add-In: Cloud Create the add-in in Visual Studio Create an Azure website Publish the add-in to the website Create a SharePoint Online App Catalog Enter the website URL into the SourceLocation tag in the manifest file Upload the manifest file to the App Catalog Add the Catalog address to the Trusted Catalogs Table in the Office Trust Center

41 Creating the Excel Add-In: Local Create the add-in in Visual Studio The website is hosted temporarily by the Internet Information Services (IIS) Express Web server spun up by Visual Studio Create and share an App Catalog folder Enter the website URL into the SourceLocation tag in the manifest file Copy the manifest file to the App Catalog folder Add the Catalog address to the Trusted Catalogs Table in the Office Trust Center

42 How to Include the ArcGIS Online Map

43

44 How to Create the Server Object Extension

45

46

47

48

49

50

51

52 Specific Process (1) 1. Select records defining species locations in Excel 2. Send data in JSON format to ArcGIS Server.NET (C#) Server Object Extension (SOE) 3. Run the Spatial Analyst ExtractMultiValuesToPoints tool a. For each point location, get the values from three land cover rasters (shrub, herbaceous, bareground) b. New field added to feature class for each raster

53 Specific Process (2) 4. Read the values from the feature class table 5. Send the raster values in JSON format back to Excel 6. Insert the values into the worksheet next to the point records

54 ExtractMultiValues SOE Main Steps 1. Convert input JSON into a usable format 2. Delete the existing point features 3. Create new point features 4. Run ExtractMultiValuesToPoints tool 5. Compile point IDs and raster values 6. Convert return data into JSON

55 How it All Fits Together

56 Cloud Configuration ArcGIS Server running on Azure Virtual Machine Data stored in ArcSDE Map service using point features Map hosted by ArcGIS Online Add-in hosted in Azure

57 Local Configuration ArcGIS Server running on laptop Data stored in file geodatabase Map service using point features Map hosted by Portal for ArcGIS on laptop Add-in hosted by IIS

58 Development Configuration ArcGIS Server running on laptop Data stored in file geodatabase Map service using point features - Not used Static map hosted by ArcGIS Online Add-in hosted by IIS Express when Visual Studio 2013 is running

59

60 Some Complications and Workarounds

61 Add-In Complications: SharePoint Online App Catalog

62 Add-In Complications: Cell References Need to use explicit cell references for output data location Select input data Determine output data placement

63 ArcGIS Server Complications: Schema Locks File geodatabase lock causes ExtractMultiValuesToPoints tool to fail General function failure Workaround for demo: Surrogate function inserts values into feature class point records Tool has worked Only ran once Second call failed ArcGIS Server service restart required

64 ArcGIS Server Complications: Fields and More Fields ExtractMultiValuesToPoints keeps adding field(s) Doesn t look good for map tooltips No option to update existing field(s) Preferred solution: Delete existing fields before running tool Complication: Delete function (ArcObjects or Delete tool) fails General function failure Workaround for demo: Create a temporary feature class, let tool keep adding fields Transfer data to main feature class, which has fixed fields

65 ArcGIS Server Complications: Debugging It s tricky

66 ArcGIS Server Complications: Debugging Run Visual Studio as Administrator Attach the ArcGIS Server Server Object Container process Set a breakpoint Call the service in Internet Explorer Step through the code Can t step back Can t make changes Close Visual Studio Don t create.soe file when running as Administrator

67 ArcGIS Server Complications: Debugging - Workaround Put the core SOE code into a.net class Create a Form Application for development/testing Use copy/paste or Beyond Compare to synchronize SOE class and Form Application class

68

69

70 ArcGIS Server Complications: Compiling When you compile the add-in to create the.soe file Have to be signed out of/close ArcGIS Server Manager to release locks.soe file not always updated (lock not released?) Sometimes need to delete existing files manually then recompile

71 ArcGIS Server Complications: Reinstallation ArcGIS Server uninstall leaves remaining files: C:\arcgisserver Data/configuration files - check before deleting C:\Program Files\ArcGIS\Server Various system files Consequence:

72

73 Next Steps

74 Next Steps: Add-In Solve security problem with SharePoint Online App Catalog Try to place return data directly into required cells without having to position cursor

75 Next Steps: ArcGIS Server File geodatabase may not be a suitable data store, even with a single user situation Could spend $1,000 to upgrade EDN subscription to allow use of ArcSDE Consider Open Source options, e.g., GeoServer

76 Takeaway Messages Potentially huge market for Office 365/GIS integration Investment in learning skills related to server and cloud technology worthwhile ArcGIS Server is problematic and expensive Persevere, Spend more, or Consider alternatives

77 Questions?

78 Coming Up Tomorrow The Art of the Helpful GIS Presentation Howes, D.A., Pardy, J., Stevenson, M. and Wittman, P. The Value of Coding for GIS Howes, D.A., Berry, J. and Paul, A. Adapting to the Evolving GIS World Paul, A., Wallis, D., Bonds Jr, R. and Howes, D.A. Slides for all sessions will be available from and

79 Thanks for Coming Slides available at: