1. What is the difference between primary storage and secondary storage?
|
|
- Carmella Morton
- 6 years ago
- Views:
Transcription
1 1. What is the difference between primary storage and secondary storage? Primary Storage is - Limited - Volatile - Expensive - Fast (May be accessed directly from the CPU) - Retrieving a single character from RAM takes about 150 nanoseconds (150 billionths of a second) Secondary Storage is - Extendible - Persistent - Cheap - slow (must be copied to main memory before being accessed by the CPU) - Retrieving the same character from disk takes about 75 milliseconds (thousandths of a second) - 75 msec is 500,000 times longer than Primary Storage. 2. What are the two major types of secondary storage devices? a. Direct Access Storage Devices (DASDs) - Offer high storage capacity and low cost - Data stored as magnetized areas on magnetic platters - surfaces - Each disk has one or more platters - A disk pack contains several magnetic platters connected to a rotating spindle Examples: - Magnetic Disks Hard Disks (high capacity, low cost per bit) - Optical Disks CD-ROM, DVD-ROM (Read-only/write-once, holds a lot of data, Cheap) b. Serial Devices - Magnetic Tapes 3. Describe the structure of the magnetic disk? - Magnetic disks support direct access to a desired location and consisted of : - Disk blocks - Tracks - Platters - Cylinder - Sectors - Disk heads - Disk Controller - Seek Time - Rotational delay
2 - Some disks have fixed-heads - As many read/write heads as there are tracks on the platter - Track is selected electronically and is therefore much faster - Cost of additional read/write heads is the limiting factor to production - Disks with an actuator are called moveable-head disks - Actuator moves the (single) read/write head per platter to the appropriate track - Disks are divided into concentric circular tracks - On each platter surface - Track capacities vary typically from 4 to 50 Kbytes - The division of the disk into sectors is hard-coded and may not be changed - Subtended at fixed angle at the center of a platter are sectors - Not all disks have their tracks divided into sectors 4. How to calculate disk capacity? - Number of cylinders = number of tracks in a surface - Track capacity = number of sector per track bytes per sector
3 - Cylinder capacity = number of surfaces track capacity - Drive capacity = number of cylinders cylinder capacity Knowing these relationships allows us to compute the amount of disk space a file is likely to require 5. How many cylinders to store a file with 20,000 fixed length records of 256 bytes each on a disk with 512 bytes per sector, 40 sectors per disk and 11 tracks per cylinder? Answer - The file is 20,000 * 256 = 5,120,000 bytes - 5,120,000 / 512 = 10,000 sectors - 10,000 / 40 = 250 tracks / 11 = cylinders - If physically contiguous cylinders are not available then the file will have to be spread out over the disk (fragmentation) 6. How can data organized on disks? Data can be organized on disk in two different ways: 1. Sectors - Physically placement of sector - Adjacent sectors - Interleaving Sectors - Clusters - Extents 2. User defined blocks. 7. How can data organized on disks using Physical placement of sectors? a. Adjacent sectors: fixed size segments of a track used to hold a file Disadvantage: physically it is not possible to read a series of sectors on the same track, after reading one sector, the disk controller take a certain amount of time to transfer data, the start of the next sector will be lost ( able to read only one sector / revolution) b. Interleaving sectors: leave an interval of several fixed sectors between adjacent logical sectors. The following figure indicates interleaving factor =
4 8. How can data organized on disks using Clusters? - The operating system file manager maps using FAT (File Allocation Table) the logical parts of the file to their corresponding physical locations to improve performance. - The file is viewed as a set of a fixed number of contiguous sectors that can be read without requiring additional seeks called clusters. - FAT: contains a list of all the clusters in a file. Each cluster entry in the FAT giving the physical location of the cluster. 9. How can data organized on disks using extents? An extent is a file stored in contiguous sectors, track and cylinders Its clusters are contiguous. The whole file can be accessed with minimum amount of seeking. An extent is possible if a disk has a lot of free space. If no contiguous free space for a file the file can be stored in two or more extents.
5 10. Define Internal Fragmentation of a disk? Internal fragmentation of a disk is the unused disk space which cannot be used by other files. To Store a file of 300-byte records in a disk of sector size 512 bytes. - Store a record in a sector. This will cause the loss of disk space, i.e., internal fragmentation. - Allow records to span in two sectors. This will save disk space. But, it may require the retrieval of two sectors when accessing a record. If the number of bytes in a file is not a multiple of the cluster size, internal fragmentation will occur in the last extent of the file. 11. Describe how can data organized on a disk using blocks? Disk tracks can be divided into integral numbers of user-defined blocks. Block size can have fixed or variable length. In block organization, different amount of data can be transferred in a single I/O operation. A block organization does not have sector-spanning and fragmentation problems. - track organization by sectors - track organization by blocks A block may contain one or several records. Each block is usually accompanied by one or more subblocks containing extra information about the data blocks.
6 - Count subblock: counting the number bytes in the accompanied data block. - Key subblock: containing the key for the last record in the data block. - When key subblocks are used, a track can be searched by the disk controller for a block or record identified by a given key. - This search is more efficient than sector-addressable schemes because it does not load the keys into primary memory. 12. What are Blocks? And why are they important? - A track is divided into blocks or pages - Block size (generally) fixed for each operating system - Typical block sizes range from 512 bytes to 4096 bytes (4 kb) - A disk with hard-coded sectors often has the sectors further subdivided onto blocks - Importance :Whole blocks are transferred between disk and main memory for processing 13. What is the difference between a cluster and FAT? - A cluster is a fixed number of contiguous sectors - All clusters on a disk are the same size - To view a file as a series of clusters and still maintain the sectored view, the file manager ties the logical sectors to the physical clusters using a file allocation table (FAT) - The file manager allocates an integer number of clusters to a file. An example: Sector size: 512 bytes, Cluster size: 2 sectors - If a file contains 10 bytes, a cluster is allocated (1024 bytes). - There may be unused space in the last cluster of a file. - This unused space contributes to internal fragmentation The FAT contains a linked list of all the clusters in a file, ordered according to the logical order of the sectors in a cluster - With each entry in the FAT is an entry giving the physical location of the cluster 14. How can operating system Read a particular byte from a disk file?
7 - The computer operating system find the correct surface, track and sector, reads the entire sector into a special area of memory called buffer - And then find the requested byte in the buffer. 15. How to choose cluster size? - Some OS allow the system administrator to choose the cluster size. - When to use large cluster size? - When disks contain large files likely to be processed sequentially. Example: Updates in a master file of bank accounts (in batch mode) - When to use Small cluster size? - When disks contain small files and/or files likely to be accessed randomly Example : online updates for airline reservation 16. Describe what is mean by Overhead? a. Preformatting overhead for sector-addressable disks - Stored at the beginning of each sector, including information about sector address, track address, and condition (whether the sector is usable or defective). - Preformatting also involves placing gaps and synchronization marks between fields of information. b. Nondata overhead for block-addressable disks - Subblocks and interblock gaps. - Block factors: number of bytes per track/block length. - In general, block factors is the greater the better. - However, larger blocks have higher potential of internal track fragmentation. 17. Calculate the space on the disk used to store a file? Suppose we need to store a file with 50,000 fixed length data records on a disk with the following characteristics: - Number of bytes/sector = Number of sectors / track = 63 - Number of tracks / cylinder = 16 - Number of cylinders = 4096 a. How many cylinders does the file require if each data record requires 256 bytes? Number of sectors for a file = (50000* 256) /512 = sector Cylinder size = 16 track * 63 sector * 512 byte = Cylinders for the file = 50000* 256 / Cylinder size (516096) = 24.8 cylinders Of course it may be that the disk does not have 24.8 physically contiguous cylinders available. So the file has to be spread out over dozens even hundreds of cylinders. 18. A Disk drive have byte / track, the amount of space taken by blocks and inter block gaps = 300 byte/block. We need to store file with 100 byte/ record.
8 a. How many records can be stored per track if the blocking factor is 10? Blocking factor = 10 Each block holds = 10 (block factor) * 100 (record size) (block data) = 1300 byte. The number of blocks that can fit on track = / 1300 = = 15 block. Number of records can be stored = 15 block * 10 record = 150 record. b. How many records can be stored per track if the blocking factor is 60? Blocking factor = 60 Each block holds = 60 (block factor) * 100 (record size) (block data) = 6300 byte. The number of blocks that can fit on track = / 6300 = 3 block. Number of records can be stored = 3 block * 60 record = 180 record. c. What do you understand from the above results? The larger blocking factor can lead to more efficient use of storage 19. Consider the following parameters of a disk: Disk capacity = MB Tracks per recording surface = 100 Number of recording surfaces = 10 Bytes per sector = 512 Min. seek time = 2 ms Avg. seek time = 8 ms Spindle speed = rpm (Assume 1 MB=1024 B) a. How many cylinders are there? Number of cylinders = Number of tracks per surface = 100 tracks/surf = 100 cylinders b. What is the capacity of a cylinder? Cylinder capacity = Total disk Capacity / No. of cylinders = MB / 100 cylinders = 200 MB/cylinder c. What is the capacity of each recording surface? Surface Capacity = Total disk Capacity / No. of recording surfaces = MB / 10 surfaces = 2000 MB/surface d. What is the capacity of one track?
9 Track Capacity = Surface Capacity / No. of tracks per surface = 2000(MB/surf) / 100(tracks/surf) = 20 MB/track e. How many sectors are there in one track? Number of sector in one track = 20(MB/track)/512(B/sector) = 20*1024/512 sectors/track = 40 sectors/track f. What is the average rotational delay? Spindle speed = rpm = rotations/60 sec Max rotational delay = 60*1000 ms/10000 rotations = 6 ms Min rotational delay = 0 ms Average rotational delay = expected value of rot. delay = (6ms+0)/2 = 3 ms g. What is the time to find and read one sector? Time find and read one sector = Average seek time + average rot. Delay + time to read (max rotational delay) = /(40) = 11 + to 3/20 = ms 20. Assume that a disk drive uses block addressing. The following subblock organization for nondate is available: - Countdata, where the extra space used by count subblock. - Interblock gaps is equivalent to 95 Bytes. This disk has usable Bytes per track, 30 tracks per cylinder, and 496 cylinders per drive. Suppose you have a file with 350,000 60Byte records that you want to store on this drive. Answer the following questions. Unless otherwise directed, assume that the blocking factor is 10 and that the Countdata subblock organization is used. a. How many blocks can be stored on one track? Block size = Blocking Factor * Record Size + Interblock gap = 10 * Bytes = 695 B Number of blocks per track = Track size / Block size = B / 695 (B/block) = 24 blocks/track b. How many records can be stored on one track? Number of records/ track = (Number of blocks /track) * (Number of records/block) = 24 blocks/track * 10 records/block = 240 records/track c. How many cylinders are required to hold the file (blocking factor 10 and Countdata format)? Number of records/cylinder = 240 rec/track * 30 tracks/cylinder = 7200 records/cylinder.
10 Number of cylinder required to hold a file = Number of records in file / number of records in cylinder = rec in file /7200 rec in cylinder = 49 cylinders for the file d. How much space will go unused totally due to internal track fragmentation and count subblocks? Total file is records = / 10 records per block = blocks. For each block 95 B/block is unused because of count subblock, Total unused space for count subblocks = (95 unused space /block) * Number of blocks = 95 * = B. Number of blocks in one track = (17017 / 695 ) = 24 Block and 337 due to internal fragmentation for one track. Number of tracks in the file = (block/file) /24 (block/track) = 1459 tracks/file. Total unused space for internal fragmentation = Number of tracks in file * unused fragmentation for one track = 1459 * 337 B = B. Therefore the total unused space = Count subblock unused space + fragmentation unused space = B = B In the rest of the questions assume that the file is organized into clusters and extents. Suppose the cluster size = 4 blocks and extent size = 15 clusters. e. How many clusters are needed to store this file? Number of clusters in file = Number of blocks in file / Cluster size = ( records / 10 (rec/block)) /4 (blocks per cluster) = 8750 clusters f. What is the number of extents? Number of Extents in file = Number of Clusters in file / extent size = ceiling (8750 clusters/ (15 clusters/extent)) = 584 extents 21. What are the factors that affect the cost of disk access? - Seek time: the time required to move the access arm to the correct cylinder. - average seek time - Rotational delay: the time required to rotate the disk so the desired sector can be placed under the read/write head. - Maximum rotational delay: time for one resolution - Average rotational delay: half of maximum rotational delay - Transfer time: the time required to read the data from the disk (Number of bytes transferred number of bytes on a track) * Rotation time or (Number of sectors transferred number of sectors in a track) * Rotation time
Operating Systems. Designed and Presented by Dr. Ayman Elshenawy Elsefy
Operating Systems Designed and Presented by Dr. Ayman Elshenawy Elsefy Dept. of Systems & Computer Eng.. AL-AZHAR University Website : eaymanelshenawy.wordpress.com Email : eaymanelshenawy@yahoo.com Reference
More informationDisks and I/O Hakan Uraz - File Organization 1
Disks and I/O 2006 Hakan Uraz - File Organization 1 Disk Drive 2006 Hakan Uraz - File Organization 2 Tracks and Sectors on Disk Surface 2006 Hakan Uraz - File Organization 3 A Set of Cylinders on Disk
More informationMass Storage. 2. What are the difference between Primary storage and secondary storage devices? Primary Storage is Devices. Secondary Storage devices
1. What are the logical organization of a file? Mass Storage 2. What are the difference between Primary storage and secondary storage devices? Primary Storage is Devices Secondary Storage devices - Limited,
More informationSecondary Storage : Outline
Secondary Storage : Outline! Magnetic Tapes! Disks Magnetic Tape "Sequential access "Compact "Easy to store and transport "Less expensive "Storing data off-line "Archival storage Organization of Data on
More informationSecondary Storage Devices: Magnetic Disks Optical Disks Floppy Disks Magnetic Tapes CENG 351 1
Secondary Storage Devices: Magnetic Disks Optical Disks Floppy Disks Magnetic Tapes CENG 351 1 Secondary Storage Devices Two major types of secondary storage devices: 1. Direct Access Storage Devices (DASDs)
More informationsecondary storage: Secondary Stg Any modern computer system will incorporate (at least) two levels of storage:
Secondary Storage 1 Any modern computer system will incorporate (at least) two levels of storage: primary storage: random access memory (RAM) typical capacity 256MB to 4GB cost per MB $0.10 typical access
More informationBBM371- Data Management. Lecture 2: Storage Devices
BBM371- Data Management Lecture 2: Storage Devices 18.10.2018 Memory Hierarchy cache Main memory disk Optical storage Tapes V NV Traveling the hierarchy: 1. speed ( higher=faster) 2. cost (lower=cheaper)
More informationDisks, Memories & Buffer Management
Disks, Memories & Buffer Management The two offices of memory are collection and distribution. - Samuel Johnson CS3223 - Storage 1 What does a DBMS Store? Relations Actual data Indexes Data structures
More informationDEPT OF ISE, NIT,RAICHUR Page 1
1. Explain briefly the short history of file structure design. (4 M) (Dec/Jan 2016), (June/July 2015). Earlier, the file access was sequential, and the cost of access grew in direct proportion to the size
More informationContents. Memory System Overview Cache Memory. Internal Memory. Virtual Memory. Memory Hierarchy. Registers In CPU Internal or Main memory
Memory Hierarchy Contents Memory System Overview Cache Memory Internal Memory External Memory Virtual Memory Memory Hierarchy Registers In CPU Internal or Main memory Cache RAM External memory Backing
More informationCPSC 421 Database Management Systems. Lecture 11: Storage and File Organization
CPSC 421 Database Management Systems Lecture 11: Storage and File Organization * Some material adapted from R. Ramakrishnan, L. Delcambre, and B. Ludaescher Today s Agenda Start on Database Internals:
More informationComputer System Architecture
CSC 203 1.5 Computer System Architecture Department of Statistics and Computer Science University of Sri Jayewardenepura Secondary Memory 2 Technologies Magnetic storage Floppy, Zip disk, Hard drives,
More informationUNIT 2 Data Center Environment
UNIT 2 Data Center Environment This chapter provides an understanding of various logical components of hosts such as file systems, volume managers, and operating systems, and their role in the storage
More informationModule 1: Basics and Background Lecture 4: Memory and Disk Accesses. The Lecture Contains: Memory organisation. Memory hierarchy. Disks.
The Lecture Contains: Memory organisation Example of memory hierarchy Memory hierarchy Disks Disk access Disk capacity Disk access time Typical disk parameters Access times file:///c /Documents%20and%20Settings/iitkrana1/My%20Documents/Google%20Talk%20Received%20Files/ist_data/lecture4/4_1.htm[6/14/2012
More informationOperating Systems. Operating Systems Professor Sina Meraji U of T
Operating Systems Operating Systems Professor Sina Meraji U of T How are file systems implemented? File system implementation Files and directories live on secondary storage Anything outside of primary
More informationUNIT 4 Device Management
UNIT 4 Device Management (A) Device Function. (B) Device Characteristic. (C) Disk space Management. (D) Allocation and Disk scheduling Methods. [4.1] Device Management Functions The management of I/O devices
More informationComputer Organization and Technology External Memory
Computer Organization and Technology External Memory Assoc. Prof. Dr. Wattanapong Kurdthongmee Division of Computer Engineering, School of Engineering and Resources, Walailak University 1 Magnetic Disk
More informationDisks & Files. Yanlei Diao UMass Amherst. Slides Courtesy of R. Ramakrishnan and J. Gehrke
Disks & Files Yanlei Diao UMass Amherst Slides Courtesy of R. Ramakrishnan and J. Gehrke DBMS Architecture Query Parser Query Rewriter Query Optimizer Query Executor Lock Manager for Concurrency Access
More informationFile Systems Part 1. Operating Systems In Depth XIV 1 Copyright 2018 Thomas W. Doeppner. All rights reserved.
File Systems Part 1 Operating Systems In Depth XIV 1 Copyright 2018 Thomas W. Doeppner. All rights reserved. Files Memory Disk Disk Operating Systems In Depth XIV 2 Copyright 2018 Thomas W. Doeppner. All
More informationSTORING DATA: DISK AND FILES
STORING DATA: DISK AND FILES CS 564- Spring 2018 ACKs: Dan Suciu, Jignesh Patel, AnHai Doan WHAT IS THIS LECTURE ABOUT? How does a DBMS store data? disk, SSD, main memory The Buffer manager controls how
More informationA track on a magnetic disk is a concentric rings where data is stored.
CS 320 Ch 6 External Memory Figure 6.1 shows a typical read/ head on a magnetic disk system. Read and heads separate. Read head uses a material that changes resistance in response to a magnetic field.
More informationIntroduction Disks RAID Tertiary storage. Mass Storage. CMSC 420, York College. November 21, 2006
November 21, 2006 The memory hierarchy Red = Level Access time Capacity Features Registers nanoseconds 100s of bytes fixed Cache nanoseconds 1-2 MB fixed RAM nanoseconds MBs to GBs expandable Disk milliseconds
More informationInitial Bootloader. On power-up, when a computer is turned on, the following operations are performed:
Initial Bootloader Introduction On power-up, when a computer is turned on, the following operations are performed: 1. The computer performs a power on self test (POST) to ensure that it meets the necessary
More informationChapter 11. I/O Management and Disk Scheduling
Operating System Chapter 11. I/O Management and Disk Scheduling Lynn Choi School of Electrical Engineering Categories of I/O Devices I/O devices can be grouped into 3 categories Human readable devices
More informationStorage System COSC UCB
Storage System COSC4201 1 1999 UCB I/O and Disks Over the years much less attention was paid to I/O compared with CPU design. As frustrating as a CPU crash is, disk crash is a lot worse. Disks are mechanical
More informationIntroduction to I/O and Disk Management
1 Secondary Storage Management Disks just like memory, only different Introduction to I/O and Disk Management Why have disks? Ø Memory is small. Disks are large. Short term storage for memory contents
More informationIntroduction to I/O and Disk Management
Introduction to I/O and Disk Management 1 Secondary Storage Management Disks just like memory, only different Why have disks? Ø Memory is small. Disks are large. Short term storage for memory contents
More informationChapter 3. Secondary Storage and System Software
Chapter 3. Secondary Storage and System Software Kim Joung-Joon Database Lab. jjkim9@db.konkuk.ac.kr Chapter Outline (1/2) 3.1 Disk 3.2 Magnetic Tape 3.3 Disk versus Tape 3.4 Introduction to CD-ROM 3.5
More informationCSE 153 Design of Operating Systems Fall 2018
CSE 153 Design of Operating Systems Fall 2018 Lecture 12: File Systems (1) Disk drives OS Abstractions Applications Process File system Virtual memory Operating System CPU Hardware Disk RAM CSE 153 Lecture
More informationMass-Storage Structure
CS 4410 Operating Systems Mass-Storage Structure Summer 2011 Cornell University 1 Today How is data saved in the hard disk? Magnetic disk Disk speed parameters Disk Scheduling RAID Structure 2 Secondary
More informationDepartment of Computer Engineering University of California at Santa Cruz. File Systems. Hai Tao
File Systems Hai Tao File System File system is used to store sources, objects, libraries and executables, numeric data, text, video, audio, etc. The file system provide access and control function for
More informationSome Examples (for DATA REPRESENTATION)
Some Examples (for DATA REPRESENTATION) NOTE: Examples are not lectured, but it is highly recommended that you go through them to check your understanding. Example: Disk Organization I Consider a (very
More informationReading and References. Input / Output. Why Input and Output? A typical organization. CSE 410, Spring 2004 Computer Systems
Reading and References Input / Output Reading» Section 8.1-8.5, Computer Organization and Design, Patterson and Hennessy CSE 410, Spring 2004 Computer Systems http://www.cs.washington.edu/education/courses/410/04sp/
More informationCS 201 The Memory Hierarchy. Gerson Robboy Portland State University
CS 201 The Memory Hierarchy Gerson Robboy Portland State University memory hierarchy overview (traditional) CPU registers main memory (RAM) secondary memory (DISK) why? what is different between these
More informationChapter 13 Disk Storage, Basic File Structures, and Hashing.
Chapter 13 Disk Storage, Basic File Structures, and Hashing. Copyright 2004 Pearson Education, Inc. Chapter Outline Disk Storage Devices Files of Records Operations on Files Unordered Files Ordered Files
More informationChapter 1 Disk Storage, Basic File Structures, and Hashing.
Chapter 1 Disk Storage, Basic File Structures, and Hashing. Adapted from the slides of Fundamentals of Database Systems (Elmasri et al., 2003) 1 Chapter Outline Disk Storage Devices Files of Records Operations
More informationStorage. CS 3410 Computer System Organization & Programming
Storage CS 3410 Computer System Organization & Programming These slides are the product of many rounds of teaching CS 3410 by Deniz Altinbuke, Kevin Walsh, and Professors Weatherspoon, Bala, Bracy, and
More informationCSCI-GA Database Systems Lecture 8: Physical Schema: Storage
CSCI-GA.2433-001 Database Systems Lecture 8: Physical Schema: Storage Mohamed Zahran (aka Z) mzahran@cs.nyu.edu http://www.mzahran.com View 1 View 2 View 3 Conceptual Schema Physical Schema 1. Create a
More informationAdministrivia. CMSC 411 Computer Systems Architecture Lecture 19 Storage Systems, cont. Disks (cont.) Disks - review
Administrivia CMSC 411 Computer Systems Architecture Lecture 19 Storage Systems, cont. Homework #4 due Thursday answers posted soon after Exam #2 on Thursday, April 24 on memory hierarchy (Unit 4) and
More informationOPERATING SYSTEM. PREPARED BY : DHAVAL R. PATEL Page 1. Q.1 Explain Memory
Q.1 Explain Memory Data Storage in storage device like CD, HDD, DVD, Pen drive etc, is called memory. The device which storage data is called storage device. E.g. hard disk, floppy etc. There are two types
More informationStoring Data: Disks and Files. Storing and Retrieving Data. Why Not Store Everything in Main Memory? Database Management Systems need to:
Storing : Disks and Files base Management System, R. Ramakrishnan and J. Gehrke 1 Storing and Retrieving base Management Systems need to: Store large volumes of data Store data reliably (so that data is
More informationVirtual Memory. Reading. Sections 5.4, 5.5, 5.6, 5.8, 5.10 (2) Lecture notes from MKP and S. Yalamanchili
Virtual Memory Lecture notes from MKP and S. Yalamanchili Sections 5.4, 5.5, 5.6, 5.8, 5.10 Reading (2) 1 The Memory Hierarchy ALU registers Cache Memory Memory Memory Managed by the compiler Memory Managed
More informationCS 405G: Introduction to Database Systems. Storage
CS 405G: Introduction to Database Systems Storage It s all about disks! Outline That s why we always draw databases as And why the single most important metric in database processing is the number of disk
More informationI/O, Disks, and RAID Yi Shi Fall Xi an Jiaotong University
I/O, Disks, and RAID Yi Shi Fall 2017 Xi an Jiaotong University Goals for Today Disks How does a computer system permanently store data? RAID How to make storage both efficient and reliable? 2 What does
More informationOverview of Storage & Indexing (i)
ICS 321 Spring 2013 Overview of Storage & Indexing (i) Asst. Prof. Lipyeow Lim Information & Computer Science Department University of Hawaii at Manoa 4/3/2013 Lipyeow Lim -- University of Hawaii at Manoa
More informationHard facts. Hard disk drives
Hard facts Text by PowerQuest, photos and drawings Vlado Damjanovski 2004 What is a hard disk? A hard disk or hard drive is the part of your computer responsible for long-term storage of information. Unlike
More informationSession: Hardware Topic: Disks. Daniel Chang. COP 3502 Introduction to Computer Science. Lecture. Copyright August 2004, Daniel Chang
Lecture Session: Hardware Topic: Disks Daniel Chang Basic Components CPU I/O Devices RAM Operating System Disks Considered I/O devices Used to hold data and programs before they are loaded to memory and
More informationReview 1-- Storing Data: Disks and Files
Review 1-- Storing Data: Disks and Files Chapter 9 [Sections 9.1-9.7: Ramakrishnan & Gehrke (Text)] AND (Chapter 11 [Sections 11.1, 11.3, 11.6, 11.7: Garcia-Molina et al. (R2)] OR Chapter 2 [Sections 2.1,
More informationStoring and Retrieving Data. Storing Data: Disks and Files. Solution 1: Techniques for making disks faster. Disks. Why Not Store Everything in Tapes?
Storing and Retrieving Storing : Disks and Files base Management Systems need to: Store large volumes of data Store data reliably (so that data is not lost!) Retrieve data efficiently Alternatives for
More informationStoring Data: Disks and Files. Storing and Retrieving Data. Why Not Store Everything in Main Memory? Chapter 7
Storing : Disks and Files Chapter 7 base Management Systems, R. Ramakrishnan and J. Gehrke 1 Storing and Retrieving base Management Systems need to: Store large volumes of data Store data reliably (so
More informationStorage Systems. Storage Systems
Storage Systems Storage Systems We already know about four levels of storage: Registers Cache Memory Disk But we've been a little vague on how these devices are interconnected In this unit, we study Input/output
More informationStorage Devices for Database Systems
Storage Devices for Database Systems 5DV120 Database System Principles Umeå University Department of Computing Science Stephen J. Hegner hegner@cs.umu.se http://www.cs.umu.se/~hegner Storage Devices for
More informationStoring and Retrieving Data. Storing Data: Disks and Files. Solution 1: Techniques for making disks faster. Disks. Why Not Store Everything in Tapes?
Storing and Retrieving Storing : Disks and Files Chapter 9 base Management Systems need to: Store large volumes of data Store data reliably (so that data is not lost!) Retrieve data efficiently Alternatives
More informationCENG3420 Lecture 08: Memory Organization
CENG3420 Lecture 08: Memory Organization Bei Yu byu@cse.cuhk.edu.hk (Latest update: February 22, 2018) Spring 2018 1 / 48 Overview Introduction Random Access Memory (RAM) Interleaving Secondary Memory
More informationCOS 318: Operating Systems. Storage Devices. Vivek Pai Computer Science Department Princeton University
COS 318: Operating Systems Storage Devices Vivek Pai Computer Science Department Princeton University http://www.cs.princeton.edu/courses/archive/fall11/cos318/ Today s Topics Magnetic disks Magnetic disk
More informationCHAPTER 11: IMPLEMENTING FILE SYSTEMS (COMPACT) By I-Chen Lin Textbook: Operating System Concepts 9th Ed.
CHAPTER 11: IMPLEMENTING FILE SYSTEMS (COMPACT) By I-Chen Lin Textbook: Operating System Concepts 9th Ed. File-System Structure File structure Logical storage unit Collection of related information File
More informationChapter 6A. Describing Storage Devices. Describing Storage Devices. Types of Storage Devices. Store data when computer is off Two processes
Chapter 6A Types of Storage Devices Describing Storage Devices Store data when computer is off Two processes Writing data Reading data 2 Describing Storage Devices Storage terms Media is the material storing
More informationECE331: Hardware Organization and Design
ECE331: Hardware Organization and Design Lecture 29: an Introduction to Virtual Memory Adapted from Computer Organization and Design, Patterson & Hennessy, UCB Overview Virtual memory used to protect applications
More informationCOS 318: Operating Systems. Storage Devices. Kai Li Computer Science Department Princeton University
COS 318: Operating Systems Storage Devices Kai Li Computer Science Department Princeton University http://www.cs.princeton.edu/courses/archive/fall11/cos318/ Today s Topics Magnetic disks Magnetic disk
More informationLecture 29. Friday, March 23 CS 470 Operating Systems - Lecture 29 1
Lecture 29 Reminder: Homework 7 is due on Monday at class time for Exam 2 review; no late work accepted. Reminder: Exam 2 is on Wednesday. Exam 2 review sheet is posted. Questions? Friday, March 23 CS
More informationDisks and Files. Storage Structures Introduction Chapter 8 (3 rd edition) Why Not Store Everything in Main Memory?
Why Not Store Everything in Main Memory? Storage Structures Introduction Chapter 8 (3 rd edition) Sharma Chakravarthy UT Arlington sharma@cse.uta.edu base Management Systems: Sharma Chakravarthy Costs
More informationData Storage and Query Answering. Data Storage and Disk Structure (2)
Data Storage and Query Answering Data Storage and Disk Structure (2) Review: The Memory Hierarchy Swapping, Main-memory DBMS s Tertiary Storage: Tape, Network Backup 3,200 MB/s (DDR-SDRAM @200MHz) 6,400
More information1.1 Bits and Bit Patterns. Boolean Operations. Figure 2.1 CPU and main memory connected via a bus. CS11102 Introduction to Computer Science
1.1 Bits and Bit Patterns CS11102 Introduction to Computer Science Data Storage 1.1 Bits and Their Storage 1.2 Main Memory 1.3 Mass Storage 1.4 Representation of information as bit patterns Bit: Binary
More informationFile System Management
Lecture 8: Storage Management File System Management Contents Non volatile memory Tape, HDD, SSD Files & File System Interface Directories & their Organization File System Implementation Disk Space Allocation
More informationChapter 4 File Systems. Tanenbaum, Modern Operating Systems 3 e, (c) 2008 Prentice-Hall, Inc. All rights reserved
Chapter 4 File Systems File Systems The best way to store information: Store all information in virtual memory address space Use ordinary memory read/write to access information Not feasible: no enough
More informationUNIVERSITY OF MASSACHUSETTS Dept. of Electrical & Computer Engineering. Computer Architecture ECE 568
UNIVERSITY OF MASSACHUSETTS Dept. of Electrical & Computer Engineering Computer Architecture ECE 568 Part 6 Input/Output Israel Koren ECE568/Koren Part.6. Motivation: Why Care About I/O? CPU Performance:
More informationOPERATING SYSTEMS CS3502 Spring Input/Output System Chapter 9
OPERATING SYSTEMS CS3502 Spring 2017 Input/Output System Chapter 9 Input/Output System Major objectives: An application s I/O requests are sent to the I/O device. Take whatever response comes back from
More informationToday: Secondary Storage! Typical Disk Parameters!
Today: Secondary Storage! To read or write a disk block: Seek: (latency) position head over a track/cylinder. The seek time depends on how fast the hardware moves the arm. Rotational delay: (latency) time
More informationStoring Data: Disks and Files
Storing Data: Disks and Files Chapter 7 (2 nd edition) Chapter 9 (3 rd edition) Yea, from the table of my memory I ll wipe away all trivial fond records. -- Shakespeare, Hamlet Database Management Systems,
More informationCSE 153 Design of Operating Systems
CSE 153 Design of Operating Systems Winter 2018 Lecture 20: File Systems (1) Disk drives OS Abstractions Applications Process File system Virtual memory Operating System CPU Hardware Disk RAM CSE 153 Lecture
More informationPrinciples of Data Management. Lecture #2 (Storing Data: Disks and Files)
Principles of Data Management Lecture #2 (Storing Data: Disks and Files) Instructor: Mike Carey mjcarey@ics.uci.edu Database Management Systems 3ed, R. Ramakrishnan and J. Gehrke 1 Today s Topics v Today
More informationStorage systems. Computer Systems Architecture CMSC 411 Unit 6 Storage Systems. (Hard) Disks. Disk and Tape Technologies. Disks (cont.
Computer Systems Architecture CMSC 4 Unit 6 Storage Systems Alan Sussman November 23, 2004 Storage systems We already know about four levels of storage: registers cache memory disk but we've been a little
More informationStoring Data: Disks and Files
Storing Data: Disks and Files Chapter 9 CSE 4411: Database Management Systems 1 Disks and Files DBMS stores information on ( 'hard ') disks. This has major implications for DBMS design! READ: transfer
More informationCh 11: Storage and File Structure
Ch 11: Storage and File Structure Overview of Physical Storage Media Magnetic Disks RAID Tertiary Storage Storage Access File Organization Organization of Records in Files Data-Dictionary Dictionary Storage
More informationu Covered: l Management of CPU & concurrency l Management of main memory & virtual memory u Currently --- Management of I/O devices
Where Are We? COS 318: Operating Systems Storage Devices Jaswinder Pal Singh Computer Science Department Princeton University (http://www.cs.princeton.edu/courses/cos318/) u Covered: l Management of CPU
More informationCSE 120: Principles of Operating Systems. Lecture 10. File Systems. November 6, Prof. Joe Pasquale
CSE 120: Principles of Operating Systems Lecture 10 File Systems November 6, 2003 Prof. Joe Pasquale Department of Computer Science and Engineering University of California, San Diego 2003 by Joseph Pasquale
More informationCOS 318: Operating Systems. Storage Devices. Jaswinder Pal Singh Computer Science Department Princeton University
COS 318: Operating Systems Storage Devices Jaswinder Pal Singh Computer Science Department Princeton University http://www.cs.princeton.edu/courses/archive/fall13/cos318/ Today s Topics Magnetic disks
More informationFILE SYSTEMS. CS124 Operating Systems Winter , Lecture 23
FILE SYSTEMS CS124 Operating Systems Winter 2015-2016, Lecture 23 2 Persistent Storage All programs require some form of persistent storage that lasts beyond the lifetime of an individual process Most
More informationStoring Data: Disks and Files
Storing Data: Disks and Files Module 2, Lecture 1 Yea, from the table of my memory I ll wipe away all trivial fond records. -- Shakespeare, Hamlet Database Management Systems, R. Ramakrishnan 1 Disks and
More informationChapter 6 - External Memory
Chapter 6 - External Memory Luis Tarrataca luis.tarrataca@gmail.com CEFET-RJ L. Tarrataca Chapter 6 - External Memory 1 / 66 Table of Contents I 1 Motivation 2 Magnetic Disks Write Mechanism Read Mechanism
More informationI/O CANNOT BE IGNORED
LECTURE 13 I/O I/O CANNOT BE IGNORED Assume a program requires 100 seconds, 90 seconds for main memory, 10 seconds for I/O. Assume main memory access improves by ~10% per year and I/O remains the same.
More informationLong-term Information Storage Must store large amounts of data Information stored must survive the termination of the process using it Multiple proces
File systems 1 Long-term Information Storage Must store large amounts of data Information stored must survive the termination of the process using it Multiple processes must be able to access the information
More informationStorage Technologies and the Memory Hierarchy
Storage Technologies and the Memory Hierarchy 198:231 Introduction to Computer Organization Lecture 12 Instructor: Nicole Hynes nicole.hynes@rutgers.edu Credits: Slides courtesy of R. Bryant and D. O Hallaron,
More informationUNIVERSITY OF MASSACHUSETTS Dept. of Electrical & Computer Engineering. Computer Architecture ECE 568
UNIVERSITY OF MASSACHUSETTS Dept. of Electrical & Computer Engineering Computer Architecture ECE 568 Part 6 Input/Output Israel Koren ECE568/Koren Part.6. CPU performance keeps increasing 26 72-core Xeon
More informationThe Fetch-Execute Cycle
The Fetch-Execute Cycle Fetch the next instruction Decode the instruction Get data (if needed) Execute the instruction Remember: In a vn machine, both instructions and data are stored in the same memory!
More informationCS3600 SYSTEMS AND NETWORKS
CS3600 SYSTEMS AND NETWORKS NORTHEASTERN UNIVERSITY Lecture 11: File System Implementation Prof. Alan Mislove (amislove@ccs.neu.edu) File-System Structure File structure Logical storage unit Collection
More informationI/O CANNOT BE IGNORED
LECTURE 13 I/O I/O CANNOT BE IGNORED Assume a program requires 100 seconds, 90 seconds for main memory, 10 seconds for I/O. Assume main memory access improves by ~10% per year and I/O remains the same.
More informationFile Systems. ECE 650 Systems Programming & Engineering Duke University, Spring 2018
File Systems ECE 650 Systems Programming & Engineering Duke University, Spring 2018 File Systems Abstract the interaction with important I/O devices Secondary storage (e.g. hard disks, flash drives) i.e.
More informationDisk Scheduling COMPSCI 386
Disk Scheduling COMPSCI 386 Topics Disk Structure (9.1 9.2) Disk Scheduling (9.4) Allocation Methods (11.4) Free Space Management (11.5) Hard Disk Platter diameter ranges from 1.8 to 3.5 inches. Both sides
More informationCS 554: Advanced Database System
CS 554: Advanced Database System Notes 02: Hardware Hector Garcia-Molina CS 245 Notes 2 1 Outline Hardware: Disks Access Times (disk) Optimizations (disk access time) Other Topics: Storage costs Using
More informationProfessor: Pete Keleher! Closures, candidate keys, canonical covers etc! Armstrong axioms!
Professor: Pete Keleher! keleher@cs.umd.edu! } Mechanisms and definitions to work with FDs! Closures, candidate keys, canonical covers etc! Armstrong axioms! } Decompositions! Loss-less decompositions,
More informationEXTERNAL MEMORY (Part 1)
Eastern Mediterranean University School of Computing and Technology ITEC255 Computer Organization & Architecture EXTERNAL MEMORY (Part 1) Introduction When external memory is discussed, one should consider
More informationDatabase Systems. November 2, 2011 Lecture #7. topobo (mit)
Database Systems November 2, 2011 Lecture #7 1 topobo (mit) 1 Announcement Assignment #2 due today Assignment #3 out today & due on 11/16. Midterm exam in class next week. Cover Chapters 1, 2,
More informationSTORAGE SYSTEMS. Operating Systems 2015 Spring by Euiseong Seo
STORAGE SYSTEMS Operating Systems 2015 Spring by Euiseong Seo Today s Topics HDDs (Hard Disk Drives) Disk scheduling policies Linux I/O schedulers Secondary Storage Anything that is outside of primary
More informationOrganization of a Surface
Organization of a Surface Each disk surface is partitioned into a number of concentric tracks. Each track is partitioned into a number of sectors. Each sector contains 512 bytes of data, plus control information
More informationStorage and File Structure. Classification of Physical Storage Media. Physical Storage Media. Physical Storage Media
Storage and File Structure Classification of Physical Storage Media Overview of Physical Storage Media Magnetic Disks RAID Tertiary Storage Storage Access File Organization Organization of Records in Files
More informationCS 471 Operating Systems. Yue Cheng. George Mason University Fall 2017
CS 471 Operating Systems Yue Cheng George Mason University Fall 2017 Review: Memory Accesses 2 Impact of Program Structure on Memory Performance o Consider an array named data with 128*128 elements o Each
More informationAdapted from instructor s supplementary material from Computer. Patterson & Hennessy, 2008, MK]
Lecture 17 Adapted from instructor s supplementary material from Computer Organization and Design, 4th Edition, Patterson & Hennessy, 2008, MK] SRAM / / Flash / RRAM / HDD SRAM / / Flash / RRAM/ HDD SRAM
More informationCS 162 Operating Systems and Systems Programming Professor: Anthony D. Joseph Spring 2002
CS 162 Operating Systems and Systems Programming Professor: Anthony D. Joseph Spring 2002 Lecture 16: Survey of I/O systems 16.0 Main Points Overhead, latency, bandwidth definitions How terminals and disks
More informationStoring Data: Disks and Files
Storing Data: Disks and Files Chapter 9 Yea, from the table of my memory I ll wipe away all trivial fond records. -- Shakespeare, Hamlet Database Management Systems 3ed, R. Ramakrishnan and J. Gehrke Disks
More information