CSE 120. Operating Systems. March 27, 2014 Lecture 17. Mass Storage. Instructor: Neil Rhodes. Wednesday, March 26, 14

Similar documents
CSE 120. Overview. July 27, Day 8 Input/Output. Instructor: Neil Rhodes. Hardware. Hardware. Hardware

CSE325 Principles of Operating Systems. Mass-Storage Systems. David P. Duggan. April 19, 2011

V. Mass Storage Systems

Che-Wei Chang Department of Computer Science and Information Engineering, Chang Gung University

Virtual Memory. Reading. Sections 5.4, 5.5, 5.6, 5.8, 5.10 (2) Lecture notes from MKP and S. Yalamanchili

u Covered: l Management of CPU & concurrency l Management of main memory & virtual memory u Currently --- Management of I/O devices

COS 318: Operating Systems. Storage Devices. Jaswinder Pal Singh Computer Science Department Princeton University

Chapter 12: Mass-Storage

CS3600 SYSTEMS AND NETWORKS

UC Santa Barbara. Operating Systems. Christopher Kruegel Department of Computer Science UC Santa Barbara

I/O CANNOT BE IGNORED

CSE 153 Design of Operating Systems Fall 2018

CISC 7310X. C11: Mass Storage. Hui Chen Department of Computer & Information Science CUNY Brooklyn College. 4/19/2018 CUNY Brooklyn College

COMP283-Lecture 3 Applied Database Management

I/O CANNOT BE IGNORED

Chapter 10: Mass-Storage Systems

Chapter 10: Mass-Storage Systems. Operating System Concepts 9 th Edition

COS 318: Operating Systems. Storage Devices. Vivek Pai Computer Science Department Princeton University

CS 134. Operating Systems. April 8, 2013 Lecture 20. Input/Output. Instructor: Neil Rhodes. Monday, April 7, 14

Computer Organization and Structure. Bing-Yu Chen National Taiwan University

Mass-Storage. ICS332 - Fall 2017 Operating Systems. Henri Casanova

Mass-Storage Structure

CSCI-GA Operating Systems. I/O : Disk Scheduling and RAID. Hubertus Franke

Introduction to I/O and Disk Management

Disks and RAID. CS 4410 Operating Systems. [R. Agarwal, L. Alvisi, A. Bracy, E. Sirer, R. Van Renesse]

CSE 153 Design of Operating Systems

Introduction to I/O and Disk Management

Storage. Hwansoo Han

Input/Output. Today. Next. Principles of I/O hardware & software I/O software layers Disks. Protection & Security

CSE 380 Computer Operating Systems

COS 318: Operating Systems. Storage Devices. Kai Li Computer Science Department Princeton University

CS420: Operating Systems. Mass Storage Structure

Chapter 10: Mass-Storage Systems

Part IV I/O System. Chapter 12: Mass Storage Structure

CMSC 424 Database design Lecture 12 Storage. Mihai Pop

Readings. Storage Hierarchy III: I/O System. I/O (Disk) Performance. I/O Device Characteristics. often boring, but still quite important

Disks. Storage Technology. Vera Goebel Thomas Plagemann. Department of Informatics University of Oslo

I/O, Disks, and RAID Yi Shi Fall Xi an Jiaotong University

Ricardo Rocha. Department of Computer Science Faculty of Sciences University of Porto

CSCI-GA Database Systems Lecture 8: Physical Schema: Storage

Today: Secondary Storage! Typical Disk Parameters!

Mass-Storage. ICS332 Operating Systems

Lecture 29. Friday, March 23 CS 470 Operating Systems - Lecture 29 1

Computer Architecture 计算机体系结构. Lecture 6. Data Storage and I/O 第六讲 数据存储和输入输出. Chao Li, PhD. 李超博士

Lecture 23. Finish-up buses Storage

Chapter 10: Mass-Storage Systems. Operating System Concepts 9 th Edition

Ricardo Rocha. Department of Computer Science Faculty of Sciences University of Porto

Storage Systems. Storage Systems

CSE 451: Operating Systems Spring Module 12 Secondary Storage. Steve Gribble

Monday, May 4, Discs RAID: Introduction Error detection and correction Error detection: Simple parity Error correction: Hamming Codes

CHAPTER 12: MASS-STORAGE SYSTEMS (A) By I-Chen Lin Textbook: Operating System Concepts 9th Ed.

Storage System COSC UCB

Mass-Storage Structure

Chapter 13: Mass-Storage Systems. Disk Scheduling. Disk Scheduling (Cont.) Disk Structure FCFS. Moving-Head Disk Mechanism

Chapter 13: Mass-Storage Systems. Disk Structure

Mass-Storage Systems. Mass-Storage Systems. Disk Attachment. Disk Attachment

Mass-Storage Systems

Computer Science 146. Computer Architecture

CSE 451: Operating Systems Spring Module 12 Secondary Storage

Chapter 11. I/O Management and Disk Scheduling

Chapter 9: Peripheral Devices: Magnetic Disks

CS370 Operating Systems

Storage Devices for Database Systems

CS 554: Advanced Database System

Administrivia. CMSC 411 Computer Systems Architecture Lecture 19 Storage Systems, cont. Disks (cont.) Disks - review

CSE 451: Operating Systems Winter Lecture 12 Secondary Storage. Steve Gribble 323B Sieg Hall.

High Performance Computing Course Notes High Performance Storage

Part IV I/O System Chapter 1 2: 12: Mass S torage Storage Structur Structur Fall 2010

Chapter 10: Mass-Storage Systems

Introduction I/O 1. I/O devices can be characterized by Behavior: input, output, storage Partner: human or machine Data rate: bytes/sec, transfers/sec

Operating Systems 2010/2011

Chapter 8. A Typical collection of I/O devices. Interrupts. Processor. Cache. Memory I/O bus. I/O controller I/O I/O. Main memory.

Appendix D: Storage Systems

BBM371- Data Management. Lecture 2: Storage Devices

Storage. CS 3410 Computer System Organization & Programming

Lecture 23: Storage Systems. Topics: disk access, bus design, evaluation metrics, RAID (Sections )

CSE 451: Operating Systems Winter Secondary Storage. Steve Gribble. Secondary storage

Chapter 9: Peripheral Devices. By: Derek Hildreth Chad Davis

Operating Systems. Mass-Storage Structure Based on Ch of OS Concepts by SGG

Operating Systems. Operating Systems Professor Sina Meraji U of T

Where We Are in This Course Right Now. ECE 152 Introduction to Computer Architecture Input/Output (I/O) Copyright 2012 Daniel J. Sorin Duke University

Lecture 9. I/O Management and Disk Scheduling Algorithms

RAID (Redundant Array of Inexpensive Disks)

Chapter 6. Storage and Other I/O Topics

Chapter-6. SUBJECT:- Operating System TOPICS:- I/O Management. Created by : - Sanjay Patel

Chapter 6 - External Memory

Chapter 6. Storage and Other I/O Topics. ICE3003: Computer Architecture Fall 2012 Euiseong Seo

Computer Architecture Computer Science & Engineering. Chapter 6. Storage and Other I/O Topics BK TP.HCM

Chapter 6. Storage and Other I/O Topics

RAID. Redundant Array of Inexpensive Disks. Industry tends to use Independent Disks

Chapter 14: Mass-Storage Systems. Disk Structure

Chapter 6 Storage and Other I/O Topics

Components of the Virtual Memory System

I/O Hardwares. Some typical device, network, and data base rates

A+ Guide to Hardware: Managing, Maintaining, and Troubleshooting, 5e. Chapter 6 Supporting Hard Drives

Operating Systems. V. Input / Output. Eurecom

Wednesday, April 25, Discs RAID: Introduction Error detection and correction Error detection: Simple parity Error correction: Hamming Codes

Key Points. Rotational delay vs seek delay Disks are slow. Techniques for making disks faster. Flash and SSDs

Tape pictures. CSE 30341: Operating Systems Principles

Lecture 13. Storage, Network and Other Peripherals

Transcription:

CSE 120 Operating Systems March 27, 2014 Lecture 17 Mass Storage Instructor: Neil Rhodes

Paging and Translation Lookaside Buffer frame dirty? no yes CPU checks TLB PTE in TLB? Free page frame? no yes OS instructs CPU to write the page to disk no Access page table y OS instructs CPU to read the page from disk CPU activates I/O hardware Page in main memory no CPU activates I/O hardware Page transferred from main memory to disk yes Update TLB Page transferred from disk to main memory Update page table return to failed instruction CPU generates physical address Update page table 2

Hardware Bus: a set of wires and protocol for communicating ISA PCI USB Memory bus Serial ATA Daisy chain: bus with cables going from one device to the next SCSI Firewire Main Memory Memory Bus PCI Bridge CPU Graphics Controller Monitor Keyboard Mouse USB Universal Serial Bus (USB) PCI Bus Disk Disk SCSI SCSI Bus Level 2 Cache IDE Disk Controller Disk Disk Disk Disk Daisy chain picture from <http://uk.geocities.com/dianne_davies/about-daisies.html> 3

Mass Storage Types Magnetic Disk Magnetic Tape Solid State Drive 4

Disks Hardware Track Disk Head Assembly Head Platter Sector Time to access a block (sector) Seek time (time to move the head in or out to the appropriate track) Rotational latency (time for the disk to spin so that the beginning of the sector is under the head) Transfer time (time for the data to be read from the sector). 5

Identifying a block Logical Block Number (LBN): 1-N Maps to: Cylinder/head/sector Who does the mapping? 6

Blocks written with ECC Blocks go bad Soft error Hard error Fixes: Sector sparing Sector slipping 7

Reading/Writing a block Seek first Wait for sector to rotate under head Read (or write) 8

Disk Specs Capacity Rotational Speed Western Digital VelociRaptor WD1500AHFD 1 TB 4 TB Seagate Desktop HDD 1.5 10,000 RPM 5,900 RPM Average rotational latency Average access time (seek + rotational) Average sustained transfer rate Buffer size 3 ms 4 ms 6.8 ms 17 ms 164 MB/s 132 MB/s 64 MiB 64 MiB 9

Disk Scheduling FCFS Shortest-seek time first (SSTF) SCAN (elevator) C-SCAN 10

RAID RAID: Redundant Array of Inexpensive Disks Compared to SLED: Single Large Expensive Disk Bunch of disks controlled by a RAID card Looks like SLED to the operating system, but provides better performance and better reliability Level 0 Striping Parallel read (for large read requests) Worse reliability Disk 1 Disk 2 Disk 3 Block 0-k LBN 0-k LBN k-2k LBN 2k-3k Block k-2k LBN 3k-4k LBN 4k-5k LBN 5k-6k Block 2k-3k LBN 6k-7k LBN 7k-8k LBN 8k-9k 11

RAID Level 1 Every strip is written twice Read from one disk while busy with another Disk 1 Disk 2 Disk 3 Disk 4 Disk 5 Disk 6 Block 0-k LBN 0-k LBN k-2k LBN 2k-3k LBN 0-k LBN k-2k LBN 2k-3k Block k-2k LBN 3k-4k LBN 4k-5k LBN 5k-6k LBN 3k-4k LBN 4k-5k LBN 5k-6k Block 2k-3k LBN 6k-7k LBN 7k-8k LBN 8k-9k LBN 6k-7k LBN 7k-8k LBN 8k-9k 12

RAID Level 2 Break each word into bits Add Hamming code Can correct any 1-bit error Can detect any 2-bit error Can lose any one drive Disks must be synchronized (rotation position and head location) Throughput increased by 16x Disk 1 Disk 2 Disk 3 Disk 18 Word 1 Err bit Err bit Bit 1 Bit 16 Word 2 Err bit Err bit Bit 1 Bit 16 Word 3 Err bit Err bit Bit 1 Bit 16 13

RAID Level 3 One extra parity drive Similar to level 2 Can t correct 1-bit errors Disk 1 Disk 2 Disk Disk 8 Disk 9 Bytes 0-7 Byte 0 Byte 1 Byte 7 XOR of bytes 0-7 Bytes 8-15 Byte 8 Byte 9 Byte 15 XOR of bytes 8-15 Bytes 16-31 Byte 16 Byte 17 Byte 31 XOR of bytes 16-31 14

RAID Level 4 Like level 0, but with extra parity drive One write, must re-read all strips to calculate parity Or, can pre-read old parity and data to compute new parity Parity drive may become bottleneck (used on every write) Can t correct 1-bit errors Disk 1 Disk 2 Disk 3 Disk 4 Block 0-k LBN 0-k LBN k-2k LBN 2k-3k Parity 0-3k Block k-2k LBN 3k-4k LBN 4k-5k LBN 5k-6k Parity 3k-6k Block 2k-3k LBN 6k-7k LBN 7k-8k LBN 8k-9k Parity 6K-9K 15

Level 5 RAID Like level 4, but with parity stripe spread across drives Disk 1 Disk 2 Disk 3 Disk 4 Block 0-k LBN 0-k LBN k-2k LBN 2k-3k Parity 0-3k Block k-2k LBN 3k-4k LBN 4k-5k Parity 3-6k LBN 5k-6k Block 2k-3k LBN 6k-7k Parity 6-9k LBN 7k-8k LBN 8k-9k 16