Network Data Analytics and IoT Success. Jim Frey VP Strategic Alliances Kentik Technologies

Transcription

1 Network Data Analytics and IoT Success Jim Frey VP Strategic Alliances Kentik Technologies

2 IoT and the Network

3 What is Being Connected for IoT Initiatives? Something Old, Something New Q. Does your organization gather data or information from any equipment, devices or other connected endpoints? n=1104 Source: 451 Research, Voice of the Enterprise: Internet of Things, Vendor Evaluations All contents Kentik Inc. 3

4 The IoT EcoSystem Endpoints and sensors Gateways and edge computing Cloud/Datacenter The (New, Common, Standard) Network All contents Kentik Inc. 4

5 IoT and the Network Yes, there s a Network, but how important is it to IoT? It s all about the data, and the architecture: Where is Data Collected? Where is Data Processed and Stored? Are you using Gateways or Edge Computing? Are you using a NEW or sharing an EXISTING network? Are you using someone else s network? All contents Kentik Inc. 5

6 Where is IoT data initially sent directly after being generated? All Applicable options selected Source: 451 Research, Voice of the Enterprise: Internet Of Things, Organizational Dynamics 2016 All contents Kentik Inc. 6 6

7 Is IoT transported to these locations between initial storage and where it is eventually kept and stored? All Applicable options selected Source: 451 Research, Voice of the Enterprise: Internet Of Things, Organizational Dynamics All contents Kentik Inc. 7

8 New vs. Shared Networks 100 Enterprise IoT practitioners (many with 1+ projects) said: 49% Using Existing LAN or WAN Networks as primary approach to IoT Connectivity 36% 32% Using new IoT-specialized WAN services, such as LoRaWAN Using connectivity packaged by IoT device or solution vendor Source: The Internet of Things & Enterprise Networks, Enterprise Mgt Assoc, May 2017 All contents Kentik Inc. 8

9 Network Challenges for IoT and Related Barriers to Success

10 Network Challenges in a Shared Environment What s different? New/different OT network protocols & techniques Dramatic increase in wireless demand Growth in IoT s last mile utilization Data flows upstream, becoming rivers, then torrents Barriers to Success Bandwidth constraints not all networks designed for this! Other netizens may not co-exist peacefully Traffic on shared networks can be highly variable Applying traditional planning, monitoring, troubleshooting tools to non-traditional IoT use cases 10 All contents Kentik Inc. 10

11 Resulting Network Issues That Impact All Traffic (including IoT) High Traffic Volumes Congestion Jitter Performance Degradations Latency Data Loss All contents Kentik Inc. 11

12 Where do Ops Practices fall down? Basic Visibility to understand scope and impact of issues at scale Actionable Insights to correct issues and restore function in near real-time Fast Data Access for exploring data when automated analytics are not enough. All contents Kentik Inc. 12

13 Greatest Challenges for IoT Network Monitoring 100 Enterprise IoT practitioners said: #1 Scalability: Too Many Devices Connected Source: The Internet of Things & Enterprise Networks, Enterprise Mgt Assoc, May 2017 All contents Kentik Inc. 13

14 How Can Network-based Monitoring Analytics Help? Expose Activity and Behaviors in Real-time Understand health and efficiency, and what is driving usage Detect and Characterize Anomalies Track and recognize disruptions in performance or normal activity levels Identify and alert behaviors of potential security concern Make Better Informed Planning Decisions Close the loop with IoT engineering and other IT teams with real data on real production activity All contents Kentik Inc. 14

15 More on Security Use Cases Network Flow Analytics can identify & be forensic basis for: Traffic flowing TO IoT devices that is coming from suspect origin Traffic flowing FROM IoT devices that is going to suspect destination Port/Protocol activity that is not expected Unusual change in volumes of activity both high and low All contents Kentik Inc. 15

16 Technology Choices for the Network Viewpoint

17 Network Monitoring Analytics Technology Landscape Part 1 Start with telemetry choices Measurement type: Active vs. Passive Metadata type: Flow vs. Packet-based Source type: Embedded vs. Sensor/Probe/Agent Location: Endpoint vs. Aggregation Point All contents Kentik Inc. 17

18 Network Monitoring Tools Deemed Most Valuable for IoT Source: The Internet of Things & Enterprise Networks, Enterprise Mgt Assoc, May 2017 All contents Kentik Inc. 18

19 Network Monitoring Analytics Technology Landscape Part 1 Start with telemetry choices Measurement type: Active vs. Passive Metadata type: Flow vs. Packet-based Source type: Embedded vs. Sensor/Probe/Agent Location: Endpoint vs. Aggregation Point Recommendation Mostly Flow, Passive, Embedded, at Aggregation Points All contents Kentik Inc. 19

20 Network Monitoring Analytics Technology Landscape Part 2 Choices for Managing and Processing Data Edge: Keep and process all data at the edge Hybrid: Preprocess at the edge and send to centralized data storage and analytics Central: Send all the data to centralized data storage and analytics Major challenge: SCALE All contents Kentik Inc. 20

21 A Promising Approach: Big Data Network Monitoring Data IS Big Data Meets Volume/Variety/Velocity Test Billions of records/day (millions/second) Big Data architectures Complex but mature Considered best practices today for open/ flexible correlation Great for analytics across mixed data sets All contents Kentik Inc. 21

22 EMA Viewpoint on Big Data and Monitoring What IT management practices are supported by big data analytics? Internal infrastructure planning 50% Hybrid/Cloud infrastructure planning 44% Ops monitoring Infrastructure security 53% 56% Troubleshooting/diagnostics 37% Service quality analysis/improvement 45% Business activity insights 35% None of the above 4% Big Data Impact on Hybrid Infrastructure Management, EMA, June 2015 All contents Kentik Inc. 22

23 Network Monitoring Analytics Technology Landscape Part 2 Choices for Managing and Processing Data Edge: Keep and process all data at the edge Hybrid: Preprocess at the edge and send to centralized data storage and analytics Central: Send all the data to centralized data storage and analytics Major challenge: SCALE Recommendation Centralized Big Data and Analytics All contents Kentik Inc. 23

24 Bringing it all together

25 Conclusions / Takeaways The Network is an essential element for IoT success Shared network environments require particular attention Traffic spikes and performance issues will be a regular occurrence Focus on Visibility, Actionable Insights, and Closed-Loop for Planning Consider Flow-based telemetry and Big Data Analytics to meet the need All contents Kentik Inc. 25

26 Jim Frey VP Strategic Thank You kentik.com