Signs of Intelligent Life: AI Simplifies IoT

Transcription

1 Signs of Intelligent Life: AI Simplifies IoT JEDEC Mobile & IOT Forum Stephen Lum Samsung Semiconductor, Inc. Copyright 2018

2 APPLICATIONS DRIVE CHANGES IN ARCHITECTURES x86 Processors Apps Processors FPGA s GPU/TPU Non-x86 processors & platforms 1 st Wave MS-DOS CPU-centric 3 rd Wave 2 nd Wave Internet PC Era 4 th Wave Mobile Data-centric NOW AI MS DOS...

3 Billions of Devices GLOBAL DEVICES & CONNECTION BOOM 2.2 connections for every human on the planet! % CAGR Other PCs Tablets TVs Non-S/P S/P 10 5 M2M Source: Cisco VNI Global IP Traffic Forecast, June 2017

4 CONNECTIONS ACTIVITY What happens in an INTERNET MINUTE? Source: #LoriLewis

5 HARDWARE-CENTRIC ERA DATA-CENTRIC ERA Memory constrained by units, data growth is unconstrained Hardware-centric Physical Era Data-centric Non-Physical Era Devices Exponential Data Growth >160ZB by 2025 IoT Technology Adoption Curve More connected devices Source: IDC, March 2017

6 ARTIFICAL INTELLIGENCE MAINSTREAM Speech, Natural Language Deep Learning Amazon Echo & Alexa Google Smart Home Devices Siri & Cortana Smart Assistants Screening Genomics Prediction Game Theory Image / Facial Recognition Autonomous Driving

7 AI SELF-FUELING EXPANSION CYCLE Consumer Devices Cloud Infrastructure Personal Assistants / Speakers Services Cars Fitness Home

8 EXAMPLES OF IOT DEVICES DATA & CLOUD Device-Level Memory TAM Cloud

9 GOOGLE HOME & OTHER SMART SPEAKERS Access to music, calendar & contacts, hub for home automation Hey Google set a reminder for when I need to leave to drive to my 4:00PM dentist appointment All set. Based on expected traffic, you will need to leave at 3:20PM Google Cloud Platform

10 AMAZON GO Shopping without cashiers - processing is done in the cloud Pilot Launched in January 2018

11 AUTONOMOUS DRIVING 4TB of Data per day per vehicle SONAR ~10-100KB PER SECOND GPS ~50KB PER SECOND RADAR ~10-100KB PER SECOND 4TB would take 4 days to transfer using 5G networks CAMERAS ~20-40MB PER SECOND LIDAR ~10-70MB PER SECOND

12 Performance AI IN THE DATA CENTER Deep Learning Benefits From More Data Data Centers Evolving To Work Smarter Deep learning Older learning algorithms Amount of data Source: Andrew Ng New chips being designed to efficiently process deep neural networks Simple thesis of deep learning: More data used to train neural networks Smarter AI! Memory needs to keep pace to prevent bottlenecks Scalability becomes more critical as consumers adopt new services

13 MEGATRENDS: HYPERSCALE CAP-EX IDC Cap-ex: Up 46% YoY in Q4 17 Projected Server Volume $B Facebook Amazon Microsoft Google Growth from IDC & A/I Enabled AI Enabled 8 IDC Source: Company Filings OEM Source: Baidu Cap-ex Growth Continuing Server Growth Shifting to AI

14 MEMORY TECHNOLOGY THAT FUELS AI & IOT GROWTH Device-Level Memory TAM Cloud

15 NAND TECHNOLOGY S LEAP TO KEEP PACE Planar NAND Was Not Sustainable V-NAND Break-through V1 V2 V3 V Traditional die shrinks no longer feasible or cost effective Benefits of V-NAND: Superior Performance & Power Unmatched Endurance Enables very high density SSDs

16 STORAGE ADVANCES IN THE CLOUD NVMe, TLC V-NAND 16TB NVMe Surging 256GB Capacity 16TB Source: Forward Insights 2017 Q4, Samsung NVMe SATA SAS Source: Forward Insights 2017 Q4 Source: Samsung

17 STORAGE ADVANCES AT THE EDGE UFS: SSD Performance for Mobile Applications [GB/s] Gear3 2L UFS is a high performance, scalable interface for storage at the edge UFS combines the key features of emmc and SSDs Gear2 2L Gear3 1L SATA UFS Card brings UFS benefits to a removable storage form factor emmc

18 DRAM ADVANCES TO MEET THE AI/IOT CHALLENGES Evolutionary and Revolutionary Advances HBM GDDR DDR LPDRAM Where Low Power Is Needed VDD2/Q (1.8V) 400Mbps LP1 0.6x 1.2V 1.2V LP2 0.9x LP3 SiP (System in Package) 0.7x 1.1V LP4 VDDQ=0.6V 0.8x LP4X HBM Stack VDD2 1.1V 0.6x 1.05V Challenge lower power and higher bandwidth HBM Where Bandwidth is Critical 0.5V LP5 6400Mbps Processor High speed interface and advanced packaging

19 MEMORY AT THE EDGE DIVERSE NEEDS Wearables Low power Low density Specialized form factors Smart Home SoC Connectivity Security Automotive Camera Display NAND DRAM AP Ctrl. Sensors Board Low cost Low mid density Low high bandwidth 2-5 years longevity High bandwidth High density Automotive reliability 7-10 years longevity

20 Summary Artificial Intelligence is enabling more innovative real-time services to be delivered to consumers AI in the Cloud simplifies edge devices, encourages their adoption with low cost of entry Autonomous vehicles, cannot be Cloud dependent, will become AI servers on wheels JEDEC has enabled tremendous advances in memory while expediting quick adoption and provides a firm foundation for memory-related ecosystems

21 Thank You!