3D NAND - Data Recovery and Erasure Verification

Similar documents
Error Recovery Flows in NAND Flash SSDs

Controller Concepts for 1y/1z nm and 3D NAND Flash

Improving LDPC Performance Via Asymmetric Sensing Level Placement on Flash Memory

Optimizes Embedded Flash-based Storage for Automotive Use

NAND Flash Basics & Error Characteristics

Self-Adaptive NAND Flash DSP

NAND Controller Reliability Challenges

NAND Flash Memory. Jinkyu Jeong Computer Systems Laboratory Sungkyunkwan University

A Self Learning Algorithm for NAND Flash Controllers

How to Extend 2D-TLC Endurance to 3,000 P/E Cycles

QLC Challenges. QLC SSD s Require Deep FTL Tuning Karl Schuh Micron. Flash Memory Summit 2018 Santa Clara, CA 1

High-Efficiency SSD for Reliable Data Storage Systems

Memory Modem TM FTL Architecture for 1Xnm / 2Xnm MLC and TLC Nand Flash. Hanan Weingarten, CTO, DensBits Technologies

Five Key Steps to High-Speed NAND Flash Performance and Reliability

Could We Make SSDs Self-Healing?

A Novel On-the-Fly NAND Flash Read Channel Parameter Estimation and Optimization

Secure data storage -

Vulnerabilities in MLC NAND Flash Memory Programming: Experimental Analysis, Exploits, and Mitigation Techniques

Improved Error Correction Capability in Flash Memory using Input / Output Pins

Designing Enterprise SSDs with Low Cost Media

Transitioning from e-mmc to UFS: Controller Design. Kevin Liu ASolid Technology Co., Ltd.

Flash Memory. 2D NAND vs. 3D NAND. White Paper F-WP002

NAND/MTD support under Linux

Using MLC Flash to Reduce System Cost in Industrial Applications

The Evolving NAND Flash Business Model for SSD

WHITE PAPER. Title What kind of NAND flash memory is used for each product? ~~~ Which is suitable SD card from reliability point of view?

dr. Jan Peter van Zandwijk

arxiv: v3 [cs.ar] 22 Sep 2017

arxiv: v2 [cs.ar] 5 Jan 2018

Advanced Flash Technology Status, Scaling Trends & Implications to Enterprise SSD Technology Enablement

Quality Comparison of SLC, MLC and emlc.

Data Retention in MLC NAND Flash Memory: Characterization, Optimization, and Recovery

Error Characterization, Mitigation, and Recovery in Flash-Memory-Based Solid-State Drives

SLC vs MLC: Considering the Most Optimal Storage Capacity

Holistic Flash Management for Next Generation All-Flash Arrays

An LDPC-Enabled Flash Controller in 40 nm CMOS

Selecting a Flash Memory Solution for Embedded Applications

FlexECC: Partially Relaxing ECC of MLC SSD for Better Cache Performance

Presented by: Nafiseh Mahmoudi Spring 2017

3SE4 Series. Customer Approver. Innodisk Approver. Customer: Customer Part Number: Innodisk Part Number: Innodisk Model Name: Date:

Reducing MLC Flash Memory Retention Errors through Programming Initial Step Only

VISUAL NAND RECONSTRUCTOR

Sub-block Wear-leveling for NAND Flash

NAND Flash-based Storage. Jin-Soo Kim Computer Systems Laboratory Sungkyunkwan University

3ME2 Series. Customer Approver. Innodisk Approver. Customer: Customer Part Number: Innodisk Part Number: Innodisk Model Name: Date:

Reducing Solid-State Storage Device Write Stress Through Opportunistic In-Place Delta Compression

NAND Flash-based Storage. Jin-Soo Kim Computer Systems Laboratory Sungkyunkwan University

Technical Notes. Considerations for Choosing SLC versus MLC Flash P/N REV A01. January 27, 2012

3ME4 Series. Customer: Customer Part Number: Innodisk Part Number: Innodisk Model Name: Date: Innodisk Approver. Customer Approver

How does a Client SSD Controller Fit the Bill in Hyperscale Applications?

WHAT HAPPENS WHEN THE FLASH INDUSTRY GOES TO TLC? Luanne M. Dauber, Pure Storage

3ME4 Series. Customer Approver. Innodisk Approver. Customer: Customer Part Number: Innodisk Part Number: Innodisk Model Name: Date:

DPA: A data pattern aware error prevention technique for NAND flash lifetime extension

2 Asst Prof, ECE Dept, Kottam College of Engineering, Chinnatekur, Kurnool, AP-INDIA.

Solid State Drives (SSDs) Jin-Soo Kim Computer Systems Laboratory Sungkyunkwan University

FLASH RELIABILITY, BEYOND DATA MANAGEMENT AND ECC. Hooman Parizi, PHD Proton Digital Systems Aug 15, 2013

NAND Flash Architecture and Specification Trends

3ME4 Series. Customer Approver. Innodisk Approver. Customer: Customer Part Number: Innodisk Part Number: Innodisk Model Name: Date:

ECC Approach for Correcting Errors Not Handled by RAID Recovery

How Good Is Your Memory? An Architect s Look Inside SSDs

Designing Enterprise Controllers with QLC 3D NAND

MS800 Series. msata Solid State Drive Datasheet. Product Feature Capacity: 32GB,64GB,128GB,256GB,512GB Flash Type: MLC NAND FLASH

Flash type comparison for SLC/MLC/TLC and Advantech s Ultra MLC technology

Raising QLC Reliability in All-Flash Arrays

Micron Quad-Level Cell Technology Brings Affordable Solid State Storage to More Applications

3MG-P Series. Customer Approver. Innodisk Approver. Customer: Customer Part Number: Innodisk Part Number: Innodisk Model Name: Date:

NAND Flash-based Storage. Jin-Soo Kim Computer Systems Laboratory Sungkyunkwan University

Increasing NAND Flash Endurance Using Refresh Techniques

HeatWatch Yixin Luo Saugata Ghose Yu Cai Erich F. Haratsch Onur Mutlu

LightNVM: The Linux Open-Channel SSD Subsystem

3ME3 Series. Customer Approver. Innodisk Approver. Customer: Customer Part Number: Innodisk Part Number: Innodisk Model Name: Date:

The Evolving NAND Flash Business Model for SSD. Steffen Hellmold VP BD, SandForce

3ME4 Series. Customer Approver. Innodisk Approver. Customer: Customer Part Number: Innodisk Part Number: Innodisk Model Name: Date:

When it comes to double-density Flash memory, some pairs are just better.

3SE4 Series. Customer Approver. Innodisk Approver. Customer: Customer Part Number: Innodisk Part Number: Innodisk Model Name: Date:

Flash Trends: Challenges and Future

NAND Flash-based Storage. Computer Systems Laboratory Sungkyunkwan University

Open Channel Solid State Drives NVMe Specification

Over provisioning in solid state hard drives: benefits, design considerations, and trade-offs in its use

System Impacts of HDD and Flash Reliability Steven Hetzler IBM Fellow Manager Storage Architecture Research

Ultra MLC Technology Introduction

3SE-P Series. Customer Approver. Approver. Customer: Customer Part Number: Innodisk Part Number: Model Name: Date:

A New Erasure Pointer Generation Scheme for Storage Class Memory

3MG-P Series. Customer Approver. Approver. Customer: Customer Part Number: Innodisk Part Number: Model Name: Date:

3ME Series. Customer Approver. Approver. Customer: Customer Part Number: Innodisk Part Number: Model Name: Date:

Differential RAID: Rethinking RAID for SSD Reliability

1MG3-P Series. Customer Approver. Innodisk Approver. Customer: Customer Part Number: Innodisk Part Number: Innodisk Model Name: Date:

Customer: Customer Part Number: Innodisk Part Number: Innodisk Model Name: Date: Innodisk Approver. Customer Approver

3D NAND Assessment for Next Generation Flash Applications

3ME4 Series. Customer Approver. Innodisk Approver. Customer: Customer Part Number: Innodisk Part Number: Innodisk Model Name: Date:

3IE Series. Customer Approver. Approver. Customer: Customer Part Number: Innodisk Part Number: Model Name: Date:

Improving the Reliability of Chip-Off Forensic Analysis of NAND Flash Memory Devices. Aya Fukami, Saugata Ghose, Yixin Luo, Yu Cai, Onur Mutlu

Developing Low Latency NVMe Systems for HyperscaleData Centers. Prepared by Engling Yeo Santa Clara, CA Date: 08/04/2017

Purity: building fast, highly-available enterprise flash storage from commodity components

3MG2-P Series. Customer Approver. Approver. Customer: Customer Part Number: Innodisk Part Number: Model Name: Date:

Flash Memory Overview: Technology & Market Trends. Allen Yu Phison Electronics Corp.

Secondary storage. CS 537 Lecture 11 Secondary Storage. Disk trends. Another trip down memory lane

Why is it that I cannot read the correct capacity of my newly purchased SD card, or that the display of capacity it becomes incorret after formatting?

Performance Assessment of an All-RRAM Solid State Drive Through a Cloud-Based Simulation Framework

3MG2-P Series. Customer Approver. Innodisk Approver. Customer: Customer Part Number: Innodisk Part Number: Innodisk Model Name: Date:

Transcription:

3D NAND - Data Recovery and Erasure Verification Robin England Hardware Research & Development Team Lead Santa Clara, CA

The Causes of SSD Data Loss What can go wrong? Logical Damage Data accidentally deleted, file system corrupted Physical Damage Liquid, fire, physical stress Electronic components Active and passive component failure Firmware Main firmware cannot be loaded into memory from NAND reserved blocks System Area Data tables corrupt or fail checksum Improper shutdown caused loss of valid context / state information Santa Clara, CA 2

NAND s Challenges and Controller s Solutions NAND has undesirable characteristics Increase in BER Charge decay Inter-cell interference Read disturb Finite programerase lifetime (write endurance) Array of NAND Flash Memory Chips SSD controller Controller must mitigate these through flash management techniques and Flash Translation Layer Reduce bit errors Error correction (ECC) Data scrambling / encryption Wear-levelling Others slow write-cycle block level only erase Physical data in NAND is not in its original format. Others Data striping Logical to physical (L2P) mapping Page & block management Need to reverse controller s processing to restore original logical data Santa Clara, CA 3

SSD Controller Recovery versus Chip-Off Recovery - Overview Transient firmware module Data out Ontrack hardware & software processes physical NAND data Error-correction Descrambling / decryption Undo data striping Undo L2P mapping Undo wear-levelling Data out (Some external processing may still be required) Special controller firmware processes physical NAND data Error-correction Descrambling / decryption Undo data striping Undo L2P mapping (possibly) Undo wear-levelling 4

SSD Controller Recovery versus Chip-Off Recovery - Comparison Advantages of Chip-Off Recovery None of the NAND is hidden from us Advantages of Controller Recovery No need to heat NAND Faster recovery turnaround Easier - some / all processing (often) done for us by controller We get a faithful copy of physical data Gain knowledge of controller internal processes Recovery still possible if:- controller not functioning no special firmware available transient upload not supported by controller Bad NAND element SSD firmware damaged beyond repair Garbage collection / re-allocation is not changing flash content Santa Clara, CA 5

The Chip-Off Recovery Process Remove NAND Minimise heat during removal (or use milling) and re-balling Avoid damage to package / pads Read NAND Socket, pin-out (interface) Logical addressing scheme (page, block, plane, die) Command set Use voltage control and read-retries (special features) Error-correction Extract (re-assemble logical data copy) Deal with striping, scrambling, decryption, L2P mapping etc.. Use information within SA where possible / applicable Santa Clara, CA 6

NAND Cell Data Density (SLC, MLC, TLC and QLC) SLC = Single-Level Cell:- data bit represented per cell MLC = Multi-Level Cell:- 2 data bits represented per cell TLC = Triple-Level Cell:- 3 data bits represented per cell QLC = Quad-Level Cell:- 4 data bits represented per cell As cell data density increases:- Storage capacity, data access latency increases. Write endurance and data retention decreases Bit Error Rate (BER) increases as does the need for Read-Retry and better ECC algorithms Santa Clara, CA 7

MLC, TLC and QLC NAND Error Correction (ECC) Read-Retry and ECC cycle Read Page BCH (Bose Chaudhuri Hocquenghem) hard-decision decoding with read-retry Set new read reference voltage (internal operation) NO Apply ECC OK? YES Finish LDPC (Low-Density Parity Check) supports soft-decision decoding with read-retry Adaptive LDPC code changes throughout life of NAND smaller (weaker) ECC when new larger (stronger) ECC as NAND ages BUT Adoption of LDPC seems to be more to do with controller development roadmap than a requirement of 3D NAND due to current use of MLC! Santa Clara, CA 8

3D NAND New Challenges - Reading Custom (non-onfi) pinout Vendor-unique signals Extended addressing modes Vendor-unique commands New set features parameters New read-retry thresholds Santa Clara, CA 9

= cell programmed / erased with ~? = victim cell, was programmed with 0 but reads closer to 2D NAND 3D NAND New Challenges - Processing Data randomisation pattern is XOR ed with user data before storage in NAND to reduce the occurrence of bit patterns ~? X-axis 3D NAND ~? Santa Clara, CA 0 ~? ~? X-axis which can cause inter-cell interference Data randomisation pattern generated typically using LFSR (Linear-Feedback Shift Register) Polynomial and pattern distribution tailored to physical layout of NAND 3D NAND adds Z-axis ~? ~? Z-axis

The Benefits of 3D NAND to Data Recovery Low BER (Bit Error Rate) 3D NAND is mostly MLC Has a bigger cell size than 2D TLC May change as cell size shrinks and 3D TLC is adopted but is good news for us right now! Low BER helps data recovery:- Requires less-intensive ECC which improves speed of processing Fewer read-retries required, which improves chip imaging speed Fewer uncorrectable pages, which simplifies mapping and increases quality of recovered data Santa Clara, CA

Ontrack SSD Erasure Verification Service (EVS) Purpose Tests the real-world effectiveness of a data erasure / sanitization method on SSD (also HDD) for manufacturers, vendors and integrators (among others) Procedure Write known byte patterns to all logical blocks (two pass, two different byte values) Run client s erase process, then analyse:- Level I (Logical) Read LBAs via SSD interface, look for known data pattern (also include hostprotected logical areas) Level II (Physical) In-depth examination of all SSD NAND flash content using Chip-Off Santa Clara, CA 2

Summary Chip-Off is needed for proper Erasure Verification on SSD and some SSD failure modes make this approach the only way to recover data Initially a steep learning curve to add support for 3D NAND as there are vendor-unique elements associated with reading and new challenges in processing However, 3D NAND is good news for Data Recovery! The current generation of 3D NAND is MLC, so there are real benefits over 2D TLC NAND We enjoy working with NAND vendors, drive manufacturers and controller chip manufacturers and collaboration helps us deliver a better service to our mutual clients Santa Clara, CA 3

Thank You! Please visit us at booth #26 Santa Clara, CA 4