Signs of Intelligent Life: AI Simplifies IoT JEDEC Mobile & IOT Forum Stephen Lum Samsung Semiconductor, Inc. Copyright 2018
APPLICATIONS DRIVE CHANGES IN ARCHITECTURES x86 Processors Apps Processors FPGA s GPU/TPU Non-x86 processors & platforms 1 st Wave MS-DOS CPU-centric 3 rd Wave 2 nd Wave Internet PC Era 4 th Wave Mobile Data-centric NOW AI MS DOS...
Billions of Devices GLOBAL DEVICES & CONNECTION BOOM 2.2 connections for every human on the planet! 30 25 20 15 10% CAGR Other PCs Tablets TVs Non-S/P S/P 10 5 M2M 0 2016 2017 2018 2019 2020 2021 Source: Cisco VNI Global IP Traffic Forecast, June 2017
CONNECTIONS ACTIVITY 2 0 1 7 What happens in an INTERNET MINUTE? Source: #LoriLewis
HARDWARE-CENTRIC ERA DATA-CENTRIC ERA Memory constrained by units, data growth is unconstrained Hardware-centric Physical Era Data-centric Non-Physical Era 160 140 Devices Exponential Data Growth >160ZB by 2025 IoT Technology Adoption Curve More connected devices 120 100 80 60 40 20 0 2005 2010 2015 2020 2025 Source: IDC, March 2017
ARTIFICAL INTELLIGENCE MAINSTREAM Speech, Natural Language Deep Learning Amazon Echo & Alexa Google Smart Home Devices Siri & Cortana Smart Assistants Screening Genomics Prediction Game Theory Image / Facial Recognition Autonomous Driving
AI SELF-FUELING EXPANSION CYCLE Consumer Devices Cloud Infrastructure Personal Assistants / Speakers Services Cars Fitness Home
EXAMPLES OF IOT DEVICES DATA & CLOUD Device-Level Memory TAM Cloud
GOOGLE HOME & OTHER SMART SPEAKERS Access to music, calendar & contacts, hub for home automation Hey Google set a reminder for when I need to leave to drive to my 4:00PM dentist appointment All set. Based on expected traffic, you will need to leave at 3:20PM Google Cloud Platform
AMAZON GO Shopping without cashiers - processing is done in the cloud Pilot Launched in January 2018
AUTONOMOUS DRIVING 4TB of Data per day per vehicle SONAR ~10-100KB PER SECOND GPS ~50KB PER SECOND RADAR ~10-100KB PER SECOND 4TB would take 4 days to transfer using 5G networks CAMERAS ~20-40MB PER SECOND LIDAR ~10-70MB PER SECOND
Performance AI IN THE DATA CENTER Deep Learning Benefits From More Data Data Centers Evolving To Work Smarter Deep learning Older learning algorithms Amount of data Source: Andrew Ng New chips being designed to efficiently process deep neural networks Simple thesis of deep learning: More data used to train neural networks Smarter AI! Memory needs to keep pace to prevent bottlenecks Scalability becomes more critical as consumers adopt new services
MEGATRENDS: HYPERSCALE CAP-EX IDC Cap-ex: Up 46% YoY in Q4 17 Projected Server Volume $B 14 12 10 Facebook Amazon Microsoft Google Growth from IDC & A/I Enabled AI Enabled 8 IDC 6 4 2 Source: Company Filings 12 17 OEM Source: Baidu 09 17 25 Cap-ex Growth Continuing Server Growth Shifting to AI
MEMORY TECHNOLOGY THAT FUELS AI & IOT GROWTH Device-Level Memory TAM Cloud
NAND TECHNOLOGY S LEAP TO KEEP PACE Planar NAND Was Not Sustainable V-NAND Break-through V1 V2 V3 V4 2013 2014 2015 2016 Traditional die shrinks no longer feasible or cost effective Benefits of V-NAND: Superior Performance & Power Unmatched Endurance Enables very high density SSDs
STORAGE ADVANCES IN THE CLOUD NVMe, TLC V-NAND 16TB NVMe Surging 256GB Capacity 16TB 2012 2013 2014 2015 2016 2017 Source: Forward Insights 2017 Q4, Samsung NVMe SATA SAS Source: Forward Insights 2017 Q4 Source: Samsung
STORAGE ADVANCES AT THE EDGE UFS: SSD Performance for Mobile Applications [GB/s] Gear3 2L UFS is a high performance, scalable interface for storage at the edge UFS combines the key features of emmc and SSDs Gear2 2L Gear3 1L SATA UFS Card brings UFS benefits to a removable storage form factor emmc
DRAM ADVANCES TO MEET THE AI/IOT CHALLENGES Evolutionary and Revolutionary Advances HBM GDDR DDR LPDRAM Where Low Power Is Needed VDD2/Q (1.8V) 400Mbps LP1 0.6x 1.2V 1.2V LP2 0.9x LP3 SiP (System in Package) 0.7x 1.1V LP4 VDDQ=0.6V 0.8x LP4X HBM Stack VDD2 1.1V 0.6x 1.05V Challenge lower power and higher bandwidth HBM Where Bandwidth is Critical 0.5V LP5 6400Mbps Processor High speed interface and advanced packaging
MEMORY AT THE EDGE DIVERSE NEEDS Wearables Low power Low density Specialized form factors Smart Home SoC Connectivity Security Automotive Camera Display NAND DRAM AP Ctrl. Sensors Board Low cost Low mid density Low high bandwidth 2-5 years longevity High bandwidth High density Automotive reliability 7-10 years longevity
Summary Artificial Intelligence is enabling more innovative real-time services to be delivered to consumers AI in the Cloud simplifies edge devices, encourages their adoption with low cost of entry Autonomous vehicles, cannot be Cloud dependent, will become AI servers on wheels JEDEC has enabled tremendous advances in memory while expediting quick adoption and provides a firm foundation for memory-related ecosystems
Thank You!