Shingled Magnetic Recording (SMR) Panel: Data Management Techniques Examined Tom Coughlin Coughlin Associates

Similar documents
October 30-31, 2014 Paris

SMR in Linux Systems. Seagate's Contribution to Legacy File Systems. Adrian Palmer, Drive Development Engineering

SMORE: A Cold Data Object Store for SMR Drives

Storage Systems for Shingled Disks

Linux Kernel Support for Hybrid SMR Devices. Damien Le Moal, Director, System Software Group, Western Digital

Novel Address Mappings for Shingled Write Disks

An SMR-aware Append-only File System Chi-Young Ku Stephen P. Morgan Futurewei Technologies, Inc. Huawei R&D USA

Storage Systems : Disks and SSDs. Manu Awasthi CASS 2018

Introduction to Open-Channel Solid State Drives and What s Next!

Skylight A Window on Shingled Disk Operation. Abutalib Aghayev, Peter Desnoyers Northeastern University

High-Performance and Large-Capacity Storage: A Winning Combination for Future Data Centers. Phil Brace August 12, 2015

Storage Systems : Disks and SSDs. Manu Awasthi July 6 th 2018 Computer Architecture Summer School 2018

Introduction to Open-Channel Solid State Drives

Linux SMR Support Status

Using SMR Drives with Smart Storage Stack-Based HBA and RAID Solutions

HiSMRfs a High Performance File System for Shingled Storage Array

HGST Shingled Magnetic Recording + HelioSeal Technology

Whither Hard Disk Archives? Dave Anderson Seagate Technology 6/2016

Scaling the Areal Density Mountain. Dave Anderson Seagate

Chunling Wang, Dandan Wang, Yunpeng Chai, Chuanwen Wang and Diansen Sun Renmin University of China

LightNVM: The Linux Open-Channel SSD Subsystem Matias Bjørling (ITU, CNEX Labs), Javier González (CNEX Labs), Philippe Bonnet (ITU)

Shingled Magnetic Recording + HelioSeal Technology. Achieving Unprecedented Storage Capacity Through Innovation

Presented by: Nafiseh Mahmoudi Spring 2017

From server-side to host-side:

Understanding SSD overprovisioning

Solid State Drives (SSDs) Jin-Soo Kim Computer Systems Laboratory Sungkyunkwan University

Open-Channel SSDs Offer the Flexibility Required by Hyperscale Infrastructure Matias Bjørling CNEX Labs

Yiying Zhang, Leo Prasath Arulraj, Andrea C. Arpaci-Dusseau, and Remzi H. Arpaci-Dusseau. University of Wisconsin - Madison

COS 318: Operating Systems. Storage Devices. Jaswinder Pal Singh Computer Science Department Princeton University

Hard Disk Drives. Nima Honarmand (Based on slides by Prof. Andrea Arpaci-Dusseau)

Using Transparent Compression to Improve SSD-based I/O Caches

Middleware and Flash Translation Layer Co-Design for the Performance Boost of Solid-State Drives

Kinetic Open Storage Platform: Enabling Break-through Economics in Scale-out Object Storage PRESENTATION TITLE GOES HERE Ali Fenn & James Hughes

16:30 18:00, June 20 (Monday), 2011 # (even student IDs) # (odd student IDs) Scope

GearDB: A GC-free Key-Value Store on HM-SMR Drives with Gear Compaction

SMORE: A Cold Data Object Store for SMR Drives (Extended Version)

Main Points. File systems. Storage hardware characteristics. File system usage patterns. Useful abstractions on top of physical devices

COS 318: Operating Systems. Storage Devices. Kai Li Computer Science Department Princeton University

u Covered: l Management of CPU & concurrency l Management of main memory & virtual memory u Currently --- Management of I/O devices

Invest in New Technologies or Divest in Market Share

STORING DATA: DISK AND FILES

I/O CANNOT BE IGNORED

Open-Channel SSDs Then. Now. And Beyond. Matias Bjørling, March 22, Copyright 2017 CNEX Labs

Copyright 2014 Fusion-io, Inc. All rights reserved.

JOURNALING FILE SYSTEMS. CS124 Operating Systems Winter , Lecture 26

ZEA, A Data Management Approach for SMR. Adam Manzanares

Getting Real: Lessons in Transitioning Research Simulations into Hardware Systems

A Light-weight Compaction Tree to Reduce I/O Amplification toward Efficient Key-Value Stores

I/O Devices & SSD. Dongkun Shin, SKKU

NAND Flash-based Storage. Jin-Soo Kim Computer Systems Laboratory Sungkyunkwan University

COS 318: Operating Systems. Storage Devices. Vivek Pai Computer Science Department Princeton University

Hyperscaler Storage. September 12, 2016

CS2410: Computer Architecture. Storage systems. Sangyeun Cho. Computer Science Department University of Pittsburgh

Operating Systems. File Systems. Thomas Ropars.

Radian MEMORY SYSTEMS

Storage Technologies - 3

HDD Data Recovery Training

Scale your Data Center with SAS Marty Czekalski Market and Ecosystem Development for Emerging Technology, Western Digital Corporation

Marty Czekalski President, SCSI Trade Association - Emerging Interface and Architecture Program Manager, Seagate Technology

Advancements in SSD Forensics

NAND Flash-based Storage. Computer Systems Laboratory Sungkyunkwan University

pblk the OCSSD FTL Linux FAST Summit 18 Javier González Copyright 2018 CNEX Labs

Year 95mm Mainstream Capacity Per Platter

SHRD: Improving Spatial Locality in Flash Storage Accesses by Sequentializing in Host and Randomizing in Device

SFS: Random Write Considered Harmful in Solid State Drives

Sentient Storage: Do SSDs have a mind of their own? Tom Kopchak

CSE 451: Operating Systems Spring Module 12 Secondary Storage

3MG2-P Series. Customer Approver. Approver. Customer: Customer Part Number: Innodisk Part Number: Model Name: Date:

Power-Efficient Data Storage

Maximizing Data Center and Enterprise Storage Efficiency

SAS Technical Update Connectivity Roadmap and MultiLink SAS Initiative Jay Neer Molex Corporation Marty Czekalski Seagate Technology LLC

(12) Patent Application Publication (10) Pub. No.: US 2014/ A1

CS 471 Operating Systems. Yue Cheng. George Mason University Fall 2017

Operating Systems. Operating Systems Professor Sina Meraji U of T

HPE Smart Array SR Gen10 User Guide

Improving throughput for small disk requests with proximal I/O

CS 537 Fall 2017 Review Session

NAND Flash-based Storage. Jin-Soo Kim Computer Systems Laboratory Sungkyunkwan University

STORAGE SYSTEMS. Operating Systems 2015 Spring by Euiseong Seo

Memories of Tomorrow

NAND Controller Reliability Challenges

Understanding the Relation between the Performance and Reliability of NAND Flash/SCM Hybrid Solid- State Drive

Chapter. Chapter. Magnetic and Solid-State Storage Devices

It Takes Guts to be Great

What is a file system

A+ Guide to Hardware: Managing, Maintaining, and Troubleshooting, 5e. Chapter 6 Supporting Hard Drives

Lecture 16: Storage Devices

BIg data era calls for Petabyte storage systems with

3MG-P Series. Customer Approver. Innodisk Approver. Customer: Customer Part Number: Innodisk Part Number: Innodisk Model Name: Date:

Intel Solid State Drive Data Center Family for PCIe* in Baidu s Data Center Environment

SAS: Today s Fast and Flexible Storage Fabric

Mark Geenen TrendFocus Presented at the THIC Meeting at the Sony Auditorium, 3300 Zanker Rd, San Jose CA March 9-10, 2004

3ME Series. Customer Approver. Innodisk Approver. Customer: Customer Part Number: Innodisk Part Number: Innodisk Model Name: Date:

[537] I/O Devices/Disks. Tyler Harter

Disks, Memories & Buffer Management

Exploiting the benefits of native programming access to NVM devices

FFS: The Fast File System -and- The Magical World of SSDs

File systems CS 241. May 2, University of Illinois

CSE 120. Operating Systems. March 27, 2014 Lecture 17. Mass Storage. Instructor: Neil Rhodes. Wednesday, March 26, 14

Ext4-zcj: An evolved journal optimized for Drive-Managed Shingled Magnetic Recording Disks

Transcription:

Shingled Magnetic Recording (SMR) Panel: Data Management Techniques Examined Tom Coughlin Coughlin Associates 2016 Data Storage Innovation Conference. Insert Your Company Name. All Rights Reserved.

Introduction SMR partially overwrites written tracks with new tracks Creates an erase process in HDDs Increase in Areal Density but increase in performance overhead too 2 2016 Data Data Storage Innovation Conference. Conference. Insert Coughlin Your Company Associates. Name. All Rights Reserved.

Session Participants Jorge Campello, Global Director of Systems and Solutions, Western Digital Mark Carlson Principal Engineer, Industry Standards, Toshiba Chair, SNIA Technical Council Josh Bingaman Firmware Engineering Manager, Seagate Technology 3 2016 Data Data Storage Innovation Conference. Conference. Insert Coughlin Your Company Associates. Name. All Rights Reserved.

How SMR is Implemented on HDDs Jorge Campello Western Digital 2016 Data Storage Innovation Conference. Insert Your Company Name. All Rights Reserved.

What is Shingled Magnetic Recording? Zone Conventional PMR HDD Data in Discrete Tracks SMR HDD Data in Zones of Overlapped Tracks SMR Standards While Zones are independent, we can t change sectors independently within a Zone. T10: ZBC T13: ZAC 2016 Data Data Storage Innovation Conference. Conference. Insert Western Your Company Digital. Name. All Rights All Rights Reserved.

Why SMR? Capacity Growth with SMR HDD Capacity without SMR SMR accelerates areal density growth Time 2016 Data Data Storage Innovation Conference. Conference. Insert Western Your Company Digital. Name. All Rights All Rights Reserved.

Some Architectural Constructs Caching Garbage Collection Stage writes to sequentialize the IOs. This can be done both on the media or on Solid State Storage. Indirection system Not a fixed mapping from LBA to physical location Over provisioning Need extra space for internal bookkeeping Need background process to fix up the data-structures. Indirection system storage Need special mechanism to maintain the indirection system. Solid State NV Storage Emergency storage for indirection system 2016 Data Data Storage Innovation Conference. Conference. Insert Western Your Company Digital. Name. All Rights All Rights Reserved.

Drive Managed Model Sequential Read Similar to PMR Random Read Similar to PMR Sequential Write Similar to PMR Random Write YMMV? 2016 Data Data Storage Innovation Conference. Conference. Insert Western Your Company Digital. Name. All Rights All Rights Reserved.

Drive Managed Model: Random Write Small Block Large Block Huge Block High Duty Cycle Performance dominated by seek time. Caching writes on media and moving later has good performance. Seek time no longer dominates. Writing twice has overhead. High duty cycle fills up cache quickly and doesn t allow time for recovery. Behaves close to sequential writes. Low Duty Cycle Performance dominated by seek time. Caching writes on media and moving later has good performance. Seek time no longer dominates. Writing twice has overhead. Low duty cycle allows drive to hide overhead. Behaves close to sequential writes. 9 2016 Data Data Storage Innovation Conference. Conference. Insert Western Your Company Digital. Name. All Rights All Rights Reserved.

SMR Management Models and Standards Mark Carlson Toshiba SNIA Technical Council 2016 Data Storage Innovation Conference. Insert Your Company Name. All Rights Reserved.

SMR Management Models Hide the complexity of SMR from host software Drive Managed model performance impact Allow the host software to manage the SMR complexity Host Managed Model best performance, but all new software Something in between Host Aware Model 11 2016 Data Data Storage Innovation Conference. Conference. Insert Toshiba. Your Company All Rights Name. Reserved. All Rights Reserved.

SMR Standards For Serial ATA (SATA) ZAC Zoned ATA Commands For Serial Attached SCSI (SAS) ZBC Zoned Block Commands Two primary commands Report Zones discover zone configuration and write pointers Reset Write Pointer reset the write pointer the the beginning of zone (destructive to zone contents) 12 2016 Data Data Storage Innovation Conference. Conference. Insert Toshiba. Your Company All Rights Name. Reserved. All Rights Reserved.

Writing to a Zoned Device Additional commands: Open Zone nail down resources for a zone Close Zone free up those resources Finish Zone fill out the remaining space Proposed simplification Allow Report Zones even in a Drive Managed model 13 2016 Data Data Storage Innovation Conference. Conference. Insert Toshiba. Your Company All Rights Name. Reserved. All Rights Reserved.

ZAC/ZBC Host Interactions Josh Bingaman Seagate Technology 2016 Data Storage Innovation Conference. Insert Your Company Name. All Rights Reserved.

Primary Host Issue: Non-Sequential Writes File modifications via appends are a primary example (write in place) - does not conform to ZAC/ZBC Host workloads would need to become copy on write for modifications and discard/trim old data This ensures writes are written at the write pointer friendly both for Host Aware as well as Host Managed Multiple ways to solve this problem 15 2016 Data Data Storage Innovation Conference. Conference. Insert Seagate Your Company Technology. Name. All Rights Reserved.

Full Stack Solution This design would require modifying file systems and relevant parts of the I/O stack as appropriate to conform to ZAC/ZBC specifications Many cases likely require extensive modifications complicated! Provides optimal performance as all layers of the stack are aware of ZAC/ZBC with no accounting overhead on system resources 16 2016 Data Data Storage Innovation Conference. Conference. Insert Seagate Your Company Technology. Name. All Rights Reserved.

Emulation / Shim: Sequentializer (STL) Translation layer akin to FTL Maintains LBA remap and requires metadata storage and searches as well as garbage collection Possible workload dependent performance implications, but majority of the I/O stack does not need to change Open Source prototype example for Linux https://github.com/seagate/zdm-device- 17 Mapper 2016 Data Data Storage Innovation Conference. Conference. Insert Seagate Your Company Technology. Name. All Rights Reserved.

Emulation / Shim: Caching Use part of the drive (conventional space) for a random cache to clean later Garbage collection and metadata tracking/searching required, similar to sequentializer Different performance tradeoffs than sequentializer 18 2016 Data Data Storage Innovation Conference. Conference. Insert Seagate Your Company Technology. Name. All Rights Reserved.

Impact of SMR on the Storage Marketplace SMR increases HDD areal density But increased performance overhead with erase cycle SMR may be best for archive or write seldom applications SMR could be path to two-dimensional magnetic recording (TDMR) which could increase AD further SMR with He could be basis of future cold storage near-line HDDs largest growing HDD segment 19 2016 Data Data Storage Innovation Conference. Conference. Insert Coughlin Your Company Associates. Name. All Rights Reserved.