EIDE Disk Arrays and Its Implement
|
|
- Barrie Elliott
- 6 years ago
- Views:
Transcription
1 EIDE Disk Arrays and Its Implement Qiong Chen Turku Center for Computer Science, ÅBO Akademi University Turku, Finland Abstract: Along with the information high-speed development, RAID, which has large capacity, high availability, and high performance, has played an important role in storage system. Comparison with SCSI disk drive, the body of EIDE disk drive is similar to SCSI s, but for long time, EIDE disk drive performance is lower than SCSI disk drive s. Recently,an EIDE drive is rapidly developed. New EIDE drive almost offers similar performance to SCSI s. At the same time, PC motherboard provides a lot of technology supports. Thus, it is possible that RAID is consisted of EIDE disk drives. Although many technologies and methods of SCSI RAID can continue to be used in EIDE RAID, there are other problems required to solve in EIDE RAID. The research work is processing. In this paper, for the first time, we propose a kind of architecture based on system integration, and a method of protocol conversion between SCSI and ATA. They should support a host to send an I/O request from a SCSI adapter to an EIDE RAID. They also support heterogeneous channel disk arrays. The test result is the performance and price ratio of EIDE RAID is better than SCSI disk arrays. Keywords: SCSI RAID, EIDE RAID, Protocol conversion, Performance/Price ratio. 1. Introduction Recently, microprocessor performance has been largely improved, and computer applications, which include parallel processing, multimedia, computer network etc, also have been largely developed. Therefore, I/O storage system is faced with greatly challenge, it is demanded with large-capacity, high-performance, and high-availability. One innovation that improved both availability and performance of storage system is redundant arrays of independent disks, acronym RAID [1,2,3,4] ; it has been promoted as the most promising technology to fit these needs. And SCSI (Small Computer System Interface) or Fiber Channel (FC) always occupies the disk drive areas of RAID. SCSI disk drive or Fiber Channel has a lot of well-known advantages; such as high data transfer rate, large capacity, and quickly access time. But it is more expensive, and it needs expensive adapter, therefore the price of RAID is very high. Comparing with SCSI disk drive, the price of EIDE (Enhanced Integrated Drive Electronics) is relevant low, its price is only 60% of SCSI disk drive, and EIDE 1
2 disks could directly be connected with ATA (Advanced Technology Attachment) interface of PC motherboard without any additional adapter. But for long time, its performance normally is lower than SCSI or Fiber Channel s. However, the biggest change was happened in late 1997, this was the creation of the Ultra ATA/DMA standard. For the first time, the new EIDE drive offers similar performance to Ultra Wide SCSI. ATA-5 defines transfer rates up to 66MB/s, with ATA-6 slated to include a 100MB/s rate, and 32-bit ATA could increase this rate to 200MB/s [5]. Since UDMA s introduction, there have been dramatic drops in cost per megabyte of the drives, this has expanded the market of the drivers, even into areas where only SCSI drivers have been seen like Mac, Sun, and SGI platforms, and RAID. Besides, some motherboards now have provided many technology supports. Until 2000, there are more than four ATA/66 EIDE interfaces on one motherboard. This means it is completely possible to construct an EIDE disk arrays. Although many technologies and methods of SCSI RAID can continue to be used in EIDE RAID, there are a lot of problems being solved in EIDE RAID, such as the architecture, the protocol, and etc. In this paper, we propose a flexible integrated EIDE RAID architecture, where a host would connect the EIDE RAID by a SCSI bus. In other words, the EIDE RAID is accessed as a SCSI disk drive. Thus, there is protocol conversion between host SCSI standard and ATA standard, in Section 4; we propose a method of protocol conversion based on direct translating and simulative translating. Lastly we compare the performance of EIDE RAID with a similar size SCSI RAID. And conclusions are given in Section Integrated Architecture An integrated EIDE RAID architecture that provides more than one of RAID levels is shown in Fig 1. It has a RAID controller, more than two EIDE (or called ATA) interfaces with one or two EIDE disk drives. The RAID controller, which is a personal computer system, receives/sends SCSI commands and data from/to a host by a SCSI bus, and carries out parity calculations, places data blocks, reconstructs and rebuilds data if a disk drive is failure. The disk drive interfaces pass commands from the RAID controller to the disk drives via an AT attachment bus. There is a PCI_SCSI I/O processor in RAID controller, which is a target, and an adapter of EIDE RAID. It would receive SCSI commands and data from a host through a SCSI bus, and also send data or message to the host. EIDE interface operation is dependent on RAID controller, only when EIDE disk drive finishes a physical operation, the RAID controller can schedule other task. 2
3 RAID controller AT attachment bus IDE disks host interconnect SCSI BUS Figure Figure1 1 EIDE IDE RAID RAID Architecture architecture 3. Operate Model of EIDE RAID In ATA standard, disk drives on the different interface can work concurrently, but the disk drives on the same interface are not operated synchronously, while there are over eight disk drives (Narrow SCSI), 16 disk drives (Wide SCSI), 32 (Very Space (1,1) (0,1) (1,0) (0,0) st st t1 t2 t3 t4 Time Figure 2 Time-Space Relation of Disk Work Wide SCSI) or 126 (FireWire) disk drives connecting a SCSI interface [6]. There is time coherence between disk drives on the same ATA interface. It means all disk drives on EIDE interfaces can t parallel work. Fig. 2 is a chart of time-space relation of two EIDE interfaces; each EIDE interface connects two disk drives. Disk (0,0) and Disk (0,1) are connected with No.1 EIDE interface, Disk (1,0) and Disk (1,1) are connected with No.2 EIDE interface. Disk (i, 0) and Disk (i, 1) cannot work synchronously, where i=0,1. Supposing t i denotes the time to start a disk drive. Disk (0,0) is started at t 1, and Disk (1,0) (maybe could be Disk (1,1)) is started at t 2. When Disk (0,0) has been completed, Disk (0,1) can be started at t 3. In the same way, when Disk (1,0) has been completed, Disk (1,1) can be started at t 4. So there are only m disk drives concurrently working at anytime, where m denotes the number of EIDE interface. 4. Protocol Conversion 3
4 The different protocols are used in EIDE RAID, one is SCSI protocol, and the other is ATA protocol. Therefore, protocol conversion between SCSI and ATA is major problem in EIDE RAID. Assuming X is the protocol translated, and Y is the target protocol, it is the general method for protocol conversion to execute a group of Y commands for an X command. However, in EIDE RAID, some SCSI commands are not interpreted by EIDE, such as MODE SENSE, INQUIRY etc. So a method called simulative conversion is proposed, which simulates the SCSI command function that is not interpreted by EIDE commands. The data structure of protocol conversion with C language is described in Table 1. Table 1 Protocol Conversion Data Structure typedef struct Trans{ char ImpMd; char ScsiCmd[10]; char *SimuData; struct IdeType *IdeCmd; struct Trans *next ; }Trans; Variable ImpMd denotes the SCSI command implement mode, ScsiCmd[10] describes a SCSI command from a host, the simulative data is pointed out by pointer variable SimuData. And the IdeCmd points to the first EIDE command that will translate a SCSI command. If direct conversion is used, ImpMd =0, and IdeCmd points at a corresponding EIDE command or a set of EIDE commands that completes the SCSI command function, while SimuData equals to NULL. Otherwise, ImpMd =1, simulative method is used, then SimuData points to the simulated data directly sent to the host, and IdeCmd equals to NULL. 4.2 Form Simulative Data The simulative data is usually the information regarding parameters of target and its attached peripheral device, such as detailed vital product data, the target wide data transfers and synchronous data transfers. The simplest method obtained the simulative data is from a SCSI disk drive, then modifying the data according to EIDE RAID configuration. For example INQUIRY command [7,8], it requests that information regarding parameters of the target and a component logical unit be sent to the application client, options allow the application client to request additional information about the target and logical unit or information about SCSI commands supported by the device server. The 4
5 standard INQUIRY data shall contain at least 36 bytes, where if 16 bits wide bus is used in EIDE RAID adapter, then the Wbus16 bit of inquiry data must be set. Same as the MODE SENSE command. 4.2 Conversion Implement The SCSI commands could be plotted out three kinds of conversion implement. The simplest doesn t need to execute any EIDE command. It only needs to check some status of Registers, e.g. TEST UNIT READY [7,8]. TEST UNIT READY command provides a means to check if the logical unit is ready. This is not a request for a self-test. If the logical unit is able to accept an appropriate medium-access command without returning CHECK CONDITION status, this command shall return a GOOD status (0x00). If the logical unit is unable to become operational or is in a state such that an application client action (e.g., START UNIT command) is required to make the unit ready, the device server shall return CHECK CONDITION status (0x01) with a sense key of NOT READY. So only respectively read the Status or Alternate Status Register of EIDE drives, if the BYS bit is equal to 0 then return 0x00 status, otherwise return 0x01 status. The second is one-by-one conversion implement, e.g. READ CAPACITY [9,10,11]. READ CAPACITY command could be directly implemented through IDENTIFY DEVICE EIDE command. The third is one-to-multi commands implement, it means that one SCSI command needs more than one EIDE commands to implement, e.g. READ/WRITE command. IdeCmd data structure definition is shown in Table 2 [12]. If a SCSI command needs more than one EIDE command to complete its function, the EIDE commands will link together by the next pointer in the data structure. In ATA standard, the addressing of the device can be either by cylinder-head-sector, for short CHS, or by the logical block address, for short LBA. Since the LBA is used in SCSI command format, the LBA is used in EIDE RAID, and there are four registers containing the LBA for any media access in ATA interface standard, so four variables are used for describing LBA address. Table 2 EIDE Command Data Structure typedef struct IdeType{ unsigned char CmdCode; // Command Code unsigned char DataLength; / / the number of sectors of data requested to be read // or written operation on a disk drive unsigned char Address1; ///Bit 7-0 of the LBA unsigned char Address2; // Bit 15-8 of the LBA 5
6 unsigned char Address3; // Bit of the LBA unsigned char Address4; // Bit of the LBA struct data_list *DataHead; // pointing data buffer in main memory struct IdeType *Next; }IdeType; A procedure of translating a SCSI READ/WRITE command into EIDE commands is as follow: 1) For simplified writing, the variable Datalength denotes IdeType->Datalength in Table 2, same as others. And the SCSI commands are respectively shown in Table 3 and Table 4 [9,10,11]. In the tables, the Logical Unit is defined in the IDENTIFY message, and It is recommended that the logical unit number in the command descriptor block will be set to zero. The Logical Block Address field specifies the logical block where the read/write operation shall begin. The Transfer Length field specifies the number of contiguous logical blocks of data to be transferred. A Transfer Length of zero indirectly indicates that 256 logical blocks shall be transferred. Any other value directly indicates the number of logical blocks that shall be transferred. 2) The Logical Block Address is evaluated to variable startaddress, and the Transfer Length is evaluated to variable datalength. 3) If datalength<0 then stop. Else turning to next step 4) If datalength>255 then DataLength=255, else DataLength=dataLength 5) datalength=datalength-255 6) Adrress1=startAddress & 0xff, Adrress2=(startAddress >> 8) & 0xff, Adrress3=(startAddress >> 16) & 0xff, Adrress4=(startAddress >> 24) & 0x0f; 7) Connecting this EIDE command into the Next pointer. 8) If datalength<0 then stop. Else startaddress= startaddress+255, and turning to step 3. Fig. 3 shows a SCSI read command to be translated into a group EIDE commands. The mean of SCSI command is that read data from the start address 0, 768 sectors length. Then it needs four EIDE read commands, their start address is different while the length of first three commands is all 255 sectors, and the last length is only 3 sectors. Table 3 READ/WRITE(6) Command Table 4 READ/WRITE(10) Command 6
7 Bit Byt e 0 Operation Code 1 Logical (MSB) 2 3 Unit MSB Logical Block Address LSB 4 Transfer Length 5 Control Bit Byt e 0 Operation Code 1 Logical Reserved Unit MSB Logical Block Address LSB 6 Reserved 7 MSB 8 Transfer LSB 9 Control length {28h, 00h, 00h, 00h, 00h, 00h, 00h, 03h, 00h, 00h} (a) A SCSI Read Command 21h FFh 00h 00h 00h 00h 21h FFh FFh 00h 00h 00h 21h FFh FEh 01h 00h 00h 21h 03h FDh 02h 00h 00h NULL (b) Corresponding EIDE commands Figure 3 Command Translation from SCSI to EIDE 5. EIDE RAID Experimental Performance and Comparison According to above idea, we construct two RAID experimental platforms, which provide levels with RAID 0, RAID 1, and RAID 5. The EIDE RAID consists of 4 ST36810A EIDE disk drives, an Asus motherboard, a Pentium MMX 200MHZ CPU, 64MB memory, and a NCR53C875 PCI-SCSI adapter. While the SCSI RAID consists of 4 ST34520N SCSI disk drives, an Asus motherboard, a Pentium MMX 7
8 200MHZ CPU, 64MB memory, and 3 NCR53C875 PCI-SCSI adapters. For availably comparing performance, the RAIDs are composed of two strings, which can work concurrently, and each string will be connected two drives, the disk drives in the same string do not work concurrently. NCR53C875 support synchronous data transfer rate up to 40MB/s. The AT attachment on Asus motherboard is Ultra ATA/66, which transfers data at burst rates up to 66Mbytes/sec. The host connects RAID via a SCSI bus. Table 5 shows the parameters of SCSI drive and EIDE drive used in the platforms [13 ]. Table 5 Disk drive parameters Drive type ST36810A ST34520N Interface Ultra ATA/66 Ultra SCSI Cylinder Number of heads Capacity 6.8GB 4.55GB Sectors/Track (avg.) Bytes per sector Spindle speed 7200rpm 7200rpm Average seek time 8.6ms 9.5ms We use Qbench [14] I/O traces as the input to RAID experimental platforms. The workload is respectively sent from the same host to SCSI RAID and EIDE RAID. It varies from 1 sector, 2 sectors, 4 sectors, 8 sectors, up to 128 sectors, where read/write one sector is 54.3%, and the other is respectively around 6.52%. And for all operations, 65% is sequential, 35% is random; read operation is 60%, write operation is 40%. We obtain the average weighted data access time and data transfer rate for all loads. The test results are shown in Fig. 4. Fig. 4 (a) shows that the data transfer rate of SCSI RAID is a little higher than EIDE RAID s for RAID 0 and RAID 1, but it is lower for RAID 5. Furthermore, Fig. 4 (b) shows that the access time of EIDE RAID is better than SCSI RAID when RAID architecture is RAID1 or RAID0, and for RAID5, EIDE RAID access time is also less than the access time of SCSI RAID. In a word, the holistic performance of EIDE disk arrays is similar to the performance of SCSI disk arrays. In other words, the performance /price ratio of EIDE disk arrays excels SCSI disk arrays. 8
9 Data Transfer Rate (MB/s) SCSI RAID IDE RAID RAID 0 RAID 1 RAID 5 RAID Level (a) Data Transfer Rate Comparison 6 Access Time (ms) SCSI RAID IDE RAID RAID 0 RAID 1 RAID 5 (b) Access Time Comparison RAID Level Figure 4 Performance Comparison 6. Conclusion The experimental results indicate that EIDE disk arrays can provide similar performance to SCSI disk arrays under the condition assumed. In other word, if the scale of I/O subsystem is not needed too large, it is very effective to structure a RAID by EIDE disk drives, and the EIDE disk arrays can provide a good performance/price ratio. Therefore it is very significative to study EIDE disk arrays. Actually, there are many kinds of disk drive, in theory, they could respectively compose a disk arrays, and the host will access the disk arrays by a SCSI-PCI adapter. In this case, there must be a protocol conversion between SCSI and other standard. This method of protocol conversion introduced in Section 4 can implement the conversion not only between SCSI and EIDE, but also between SCSI and other standard. References [1] D.Patterson, G. Gibson and R. Katz A Case for Redundant arrays of Inexpensive Disks (RAID) Proc. Of the ACM SIGMOD 88, (June),
10 [2] P. M. Chen, E. K. Lee, G. A. Gibson, R. H. Katz, and D. A. Patterson; RAID: High-Performance, Reliable Secondary Storage, ACM Computing Surveys, Vol.26, No.2, June 1994, pp [3] G. R. Ganger, B. L. Worthington, R. Y. Hou, Y. N. Patt, Disk Array High-Performance, High-Reliability Storage Subsystem, IEEE Computer, March 1994, pp [4] P.M.Chen, E.K.Lee, G.A.Gibson, R.H.Katz and D.A.Patterson, RAID: High-performance, Reliable Secondary Storage, ACM Computing Surveys, vol.26, No.2, 1994, [5] ATA Host Adapter Standards Proposal, 6 October [6] SCSI & IDE. [7] Information Technology--SCSI-3 Primary Commands. Revision 11, 28 March ftp://ftp.t10.org/t10/drafts/spc/spc-r11a.pdf [8] Information Technology--SCSI Primary Commands - 2 (SPC-2). Revision 20, 18 July ftp://ftp.t10.org/t10/drafts/spc2/spc2r20.pdf [9] Information Technology SCSI 3 Block Commands (SBC). Revision 8c, 13 November ftp://ftp.t11.org/t10/drafts/sbc/sbc-r08c.pdf [10] Information Technology SCSI Block Commands-2 (SBC2) Revision 4 28 July ftp://ftp.t11.org/t10/drafts/sbc2/sbc2r04.pdf [11] SCSI-2 Specification. [12] Information Technology At Attachment-3 Interface (ATA-3). Revision 7b, 27 January [13] [14] Quantum Co.: Storage Basics. 10
04-075r0 SBC-2 Obsolete more features 27 February 2004
To: T10 Technical Committee From: Rob Elliott, HP (elliott@hp.com) Date: 27 February 200 Subject: 0-075r0 SBC-2 Obsolete more features Revision history Revision 0 (27 February 200) First revision Related
More informationUC Santa Barbara. Operating Systems. Christopher Kruegel Department of Computer Science UC Santa Barbara
Operating Systems Christopher Kruegel Department of Computer Science http://www.cs.ucsb.edu/~chris/ Input and Output Input/Output Devices The OS is responsible for managing I/O devices Issue requests Manage
More informationIntroduction to I/O and Disk Management
1 Secondary Storage Management Disks just like memory, only different Introduction to I/O and Disk Management Why have disks? Ø Memory is small. Disks are large. Short term storage for memory contents
More informationIntroduction to I/O and Disk Management
Introduction to I/O and Disk Management 1 Secondary Storage Management Disks just like memory, only different Why have disks? Ø Memory is small. Disks are large. Short term storage for memory contents
More informationSolid-state drive controller with embedded RAID functions
LETTER IEICE Electronics Express, Vol.11, No.12, 1 6 Solid-state drive controller with embedded RAID functions Jianjun Luo 1, Lingyan-Fan 1a), Chris Tsu 2, and Xuan Geng 3 1 Micro-Electronics Research
More informationLecture 23. Finish-up buses Storage
Lecture 23 Finish-up buses Storage 1 Example Bus Problems, cont. 2) Assume the following system: A CPU and memory share a 32-bit bus running at 100MHz. The memory needs 50ns to access a 64-bit value from
More informationSCSI is often the best choice of bus for high-specification systems. It has many advantages over IDE, these include:
13 SCSI 13.1 Introduction SCSI is often the best choice of bus for high-specification systems. It has many advantages over IDE, these include: A single bus system for up to seven connected devices. It
More informationRAID (Redundant Array of Inexpensive Disks)
Magnetic Disk Characteristics I/O Connection Structure Types of Buses Cache & I/O I/O Performance Metrics I/O System Modeling Using Queuing Theory Designing an I/O System RAID (Redundant Array of Inexpensive
More informationReadings. Storage Hierarchy III: I/O System. I/O (Disk) Performance. I/O Device Characteristics. often boring, but still quite important
Storage Hierarchy III: I/O System Readings reg I$ D$ L2 L3 memory disk (swap) often boring, but still quite important ostensibly about general I/O, mainly about disks performance: latency & throughput
More informationLinux Software RAID Level 0 Technique for High Performance Computing by using PCI-Express based SSD
Linux Software RAID Level Technique for High Performance Computing by using PCI-Express based SSD Jae Gi Son, Taegyeong Kim, Kuk Jin Jang, *Hyedong Jung Department of Industrial Convergence, Korea Electronics
More information03-344r2 SPC-3 SAM-3 Report all initiator and target ports 30 December 2003
To: T10 Technical Committee From: Rob Elliott, HP (elliott@hp.com) Date: 0 December 200 Subject: 0-44r2 SPC- SAM- Report all initiator and target ports Revision history Revision 0 (6 October 200) First
More informationCISC 7310X. C11: Mass Storage. Hui Chen Department of Computer & Information Science CUNY Brooklyn College. 4/19/2018 CUNY Brooklyn College
CISC 7310X C11: Mass Storage Hui Chen Department of Computer & Information Science CUNY Brooklyn College 4/19/2018 CUNY Brooklyn College 1 Outline Review of memory hierarchy Mass storage devices Reliability
More informationCSE 120. Operating Systems. March 27, 2014 Lecture 17. Mass Storage. Instructor: Neil Rhodes. Wednesday, March 26, 14
CSE 120 Operating Systems March 27, 2014 Lecture 17 Mass Storage Instructor: Neil Rhodes Paging and Translation Lookaside Buffer frame dirty? no yes CPU checks TLB PTE in TLB? Free page frame? no yes OS
More informationStorage. CS 3410 Computer System Organization & Programming
Storage CS 3410 Computer System Organization & Programming These slides are the product of many rounds of teaching CS 3410 by Deniz Altinbuke, Kevin Walsh, and Professors Weatherspoon, Bala, Bracy, and
More informationInput/Output. Today. Next. Principles of I/O hardware & software I/O software layers Disks. Protection & Security
Input/Output Today Principles of I/O hardware & software I/O software layers Disks Next Protection & Security Operating Systems and I/O Two key operating system goals Control I/O devices Provide a simple,
More informationComputer Science 146. Computer Architecture
Computer Science 46 Computer Architecture Spring 24 Harvard University Instructor: Prof dbrooks@eecsharvardedu Lecture 22: More I/O Computer Science 46 Lecture Outline HW5 and Project Questions? Storage
More informationLecture 23: I/O Redundant Arrays of Inexpensive Disks Professor Randy H. Katz Computer Science 252 Spring 1996
Lecture 23: I/O Redundant Arrays of Inexpensive Disks Professor Randy H Katz Computer Science 252 Spring 996 RHKS96 Review: Storage System Issues Historical Context of Storage I/O Storage I/O Performance
More informationFigure 5.1 (a) A single-sided disk with read/write hardware. (b) A disk pack with read/write hardware.
Figure 5.1 (a) A single-sided disk with read/write hardware. (b) A disk pack with read/write hardware. track (a) arm actuator read/write head spindle disk rotation (b) cylinder of tracks (imaginary) actuator
More information03-344r4 SPC-3 SAM-3 Report all initiator and target ports 9 February 2004
To: T10 Technical Committee From: Rob Elliott, HP (elliott@hp.com) Date: 9 February 2004 Subject: 0-44r4 SPC- SAM- Report all initiator and target ports Revision history Revision 0 (6 October 200) First
More informationImplementation and Performance Evaluation of RAPID-Cache under Linux
Implementation and Performance Evaluation of RAPID-Cache under Linux Ming Zhang, Xubin He, and Qing Yang Department of Electrical and Computer Engineering, University of Rhode Island, Kingston, RI 2881
More information04-082r0 SBC-2 Replace Notch and Partition mode page with READ CAPACITY 5 March 2004
To: T10 Technical Committee From: Rob Elliott, HP (elliott@hp.com) Date: 5 March 2004 Subject: 04-082r0 SBC-2 Replace Notch and Partition mode page with READ CAPACITY Revision history Revision 0 (5 March
More informationCHAPTER 12: MASS-STORAGE SYSTEMS (A) By I-Chen Lin Textbook: Operating System Concepts 9th Ed.
CHAPTER 12: MASS-STORAGE SYSTEMS (A) By I-Chen Lin Textbook: Operating System Concepts 9th Ed. Chapter 12: Mass-Storage Systems Overview of Mass-Storage Structure Disk Structure Disk Attachment Disk Scheduling
More informationComputer Organization and Structure. Bing-Yu Chen National Taiwan University
Computer Organization and Structure Bing-Yu Chen National Taiwan University Storage and Other I/O Topics I/O Performance Measures Types and Characteristics of I/O Devices Buses Interfacing I/O Devices
More informationStorage. Hwansoo Han
Storage Hwansoo Han I/O Devices I/O devices can be characterized by Behavior: input, out, storage Partner: human or machine Data rate: bytes/sec, transfers/sec I/O bus connections 2 I/O System Characteristics
More informationChapter 13 Disk Storage, Basic File Structures, and Hashing.
Chapter 13 Disk Storage, Basic File Structures, and Hashing. Copyright 2004 Pearson Education, Inc. Chapter Outline Disk Storage Devices Files of Records Operations on Files Unordered Files Ordered Files
More informationStorage System. Distributor. Network. Drive. Drive. Storage System. Controller. Controller. Disk. Disk
HRaid: a Flexible Storage-system Simulator Toni Cortes Jesus Labarta Universitat Politecnica de Catalunya - Barcelona ftoni, jesusg@ac.upc.es - http://www.ac.upc.es/hpc Abstract Clusters of workstations
More informationNull second level LUN (0000h) (LSB) Null third level LUN (0000h) Null fourth level LUN (0000h)
Date: October 10, 2005 To: T10 Committee (SCSI) From: George Penokie (IBM/Tivoli) Subject: SAM-4: Addressing more than 16384 logical units 1 Overview There are storage subsystems that are exceeding the
More informationChapter 6 Storage and Other I/O Topics
Department of Electr rical Eng ineering, Chapter 6 Storage and Other I/O Topics 王振傑 (Chen-Chieh Wang) ccwang@mail.ee.ncku.edu.tw ncku edu Feng-Chia Unive ersity Outline 6.1 Introduction 6.2 Dependability,
More informationChapter 1 Disk Storage, Basic File Structures, and Hashing.
Chapter 1 Disk Storage, Basic File Structures, and Hashing. Adapted from the slides of Fundamentals of Database Systems (Elmasri et al., 2003) 1 Chapter Outline Disk Storage Devices Files of Records Operations
More informationQuiz for Chapter 6 Storage and Other I/O Topics 3.10
Date: 3.10 Not all questions are of equal difficulty. Please review the entire quiz first and then budget your time carefully. Name: Course: 1. [6 points] Give a concise answer to each of the following
More informationMass-Storage Structure
Operating Systems (Fall/Winter 2018) Mass-Storage Structure Yajin Zhou (http://yajin.org) Zhejiang University Acknowledgement: some pages are based on the slides from Zhi Wang(fsu). Review On-disk structure
More informationBBM371- Data Management. Lecture 2: Storage Devices
BBM371- Data Management Lecture 2: Storage Devices 18.10.2018 Memory Hierarchy cache Main memory disk Optical storage Tapes V NV Traveling the hierarchy: 1. speed ( higher=faster) 2. cost (lower=cheaper)
More informationChapter 10: Mass-Storage Systems
Chapter 10: Mass-Storage Systems Silberschatz, Galvin and Gagne 2013 Chapter 10: Mass-Storage Systems Overview of Mass Storage Structure Disk Structure Disk Attachment Disk Scheduling Disk Management Swap-Space
More informationData Block. Data Block. Copy A B C D P HDD 0 HDD 1 HDD 2 HDD 3 HDD 4 HDD 0 HDD 1
RAID Network RAID File System 1) Takashi MATSUMOTO 1) ( 101-8430 2{1{2 E-mail:tmatsu@nii.ac.jp) ABSTRACT. The NRFS is a brand-new kernel-level subsystem for a low-cost distributed le system with fault-tolerant
More informationChapter 12: Mass-Storage
Chapter 12: Mass-Storage Systems Chapter 12: Mass-Storage Systems Revised 2010. Tao Yang Overview of Mass Storage Structure Disk Structure Disk Attachment Disk Scheduling Disk Management Swap-Space Management
More informationLecture 29. Friday, March 23 CS 470 Operating Systems - Lecture 29 1
Lecture 29 Reminder: Homework 7 is due on Monday at class time for Exam 2 review; no late work accepted. Reminder: Exam 2 is on Wednesday. Exam 2 review sheet is posted. Questions? Friday, March 23 CS
More informationWhere We Are in This Course Right Now. ECE 152 Introduction to Computer Architecture Input/Output (I/O) Copyright 2012 Daniel J. Sorin Duke University
Introduction to Computer Architecture Input/Output () Copyright 2012 Daniel J. Sorin Duke University Slides are derived from work by Amir Roth (Penn) Spring 2012 Where We Are in This Course Right Now So
More informationData rate - The data rate is the number of bytes per second that the drive can deliver to the CPU.
A+ Guide to Hardware, 4e Chapter 7 Hard Drives Learning from Floppy Drives Floppy drives are an obsolescent technology Replacements: CD drives and USB flash memory Good reasons for studying floppy drive
More informationChapter 10: Mass-Storage Systems. Operating System Concepts 9 th Edition
Chapter 10: Mass-Storage Systems Silberschatz, Galvin and Gagne 2013 Chapter 10: Mass-Storage Systems Overview of Mass Storage Structure Disk Structure Disk Attachment Disk Scheduling Disk Management Swap-Space
More informationV. Mass Storage Systems
TDIU25: Operating Systems V. Mass Storage Systems SGG9: chapter 12 o Mass storage: Hard disks, structure, scheduling, RAID Copyright Notice: The lecture notes are mainly based on modifications of the slides
More informationA+ Guide to Hardware, 4e. Chapter 7 Hard Drives
A+ Guide to Hardware, 4e Chapter 7 Hard Drives Objectives Learn how the organization of data on floppy drives and hard drives is similar Learn about hard drive technologies Learn how a computer communicates
More informationA+ Guide to Managing and Maintaining your PC, 6e. Chapter 8 Hard Drives
A+ Guide to Managing and Maintaining your PC, 6e Chapter 8 Hard Drives Introduction Hard drive: most important secondary storage device Hard drive technologies have evolved rapidly Hard drive capacities
More informationStorage: HDD, SSD and RAID
Storage: HDD, SSD and RAID Johan Montelius KTH 2017 1 / 33 Why? 2 / 33 Why? Give me two reasons why we would like to have secondary storage? 2 / 33 Computer architecture Gigabyte Z170 Gaming 2 PCIe x16/x4
More informationStorage Systems. Storage Systems
Storage Systems Storage Systems We already know about four levels of storage: Registers Cache Memory Disk But we've been a little vague on how these devices are interconnected In this unit, we study Input/output
More informationWhy? Storage: HDD, SSD and RAID. Computer architecture. Computer architecture. 10 µs - 10 ms. Johan Montelius
Why? Storage: HDD, SSD and RAID Johan Montelius Give me two reasons why we would like to have secondary storage? KTH 2017 1 / 33 Computer architecture 2 4 2 6 4 6 2 1 1 4 Computer architecture GPU Gigabyte
More informationIBM System Storage TS3100 Tape Library and TS3200 Tape Library. Reference. Machine Type 3573 GA
IBM System Storage TS3100 Tape Library and TS3200 Tape Library SCSI Reference Machine Type 3573 GA32-0547-01 Second Edition (June 2006) This edition applies to the IBM System Storage TM TS3100 Tape Library
More informationA+ Guide to Hardware: Managing, Maintaining, and Troubleshooting, 5e. Chapter 6 Supporting Hard Drives
A+ Guide to Hardware: Managing, Maintaining, and Troubleshooting, 5e Chapter 6 Supporting Hard Drives Objectives Learn about the technologies used inside a hard drive and how data is organized on the drive
More informationStorage Technologies and the Memory Hierarchy
Storage Technologies and the Memory Hierarchy 198:231 Introduction to Computer Organization Lecture 12 Instructor: Nicole Hynes nicole.hynes@rutgers.edu Credits: Slides courtesy of R. Bryant and D. O Hallaron,
More informationI/O CANNOT BE IGNORED
LECTURE 13 I/O I/O CANNOT BE IGNORED Assume a program requires 100 seconds, 90 seconds for main memory, 10 seconds for I/O. Assume main memory access improves by ~10% per year and I/O remains the same.
More informationComputer Architecture
Computer Architecture Computer Architecture Hardware INFO 2603 Platform Technologies Week 1: 04-Sept-2018 Computer architecture refers to the overall design of the physical parts of a computer. It examines:
More informationStorage: HDD, SSD and RAID
Storage: HDD, SSD and RAID Johan Montelius KTH 2017 1 / 33 Why? Give me two reasons why we would like to have secondary storage? 2 / 33 Computer architecture Gigabyte Z170 Gaming 2 4 2 6 4 6 2 1 1 4 PCIe
More informationAdministrivia. CMSC 411 Computer Systems Architecture Lecture 19 Storage Systems, cont. Disks (cont.) Disks - review
Administrivia CMSC 411 Computer Systems Architecture Lecture 19 Storage Systems, cont. Homework #4 due Thursday answers posted soon after Exam #2 on Thursday, April 24 on memory hierarchy (Unit 4) and
More informationI/O CANNOT BE IGNORED
LECTURE 13 I/O I/O CANNOT BE IGNORED Assume a program requires 100 seconds, 90 seconds for main memory, 10 seconds for I/O. Assume main memory access improves by ~10% per year and I/O remains the same.
More informationOperating Systems 2010/2011
Operating Systems 2010/2011 Input/Output Systems part 2 (ch13, ch12) Shudong Chen 1 Recap Discuss the principles of I/O hardware and its complexity Explore the structure of an operating system s I/O subsystem
More informationInput/Output. Today. Next. ! Principles of I/O hardware & software! I/O software layers! Secondary storage. ! File systems
Input/Output Today! Principles of I/O hardware & software! I/O software layers! Secondary storage Next! File systems Operating systems and I/O! Two key operating system goals Control I/O devices Provide
More informationCSE 153 Design of Operating Systems Fall 2018
CSE 153 Design of Operating Systems Fall 2018 Lecture 12: File Systems (1) Disk drives OS Abstractions Applications Process File system Virtual memory Operating System CPU Hardware Disk RAM CSE 153 Lecture
More informationAustralian Journal of Basic and Applied Sciences
ISSN:1991-8178 Australian Journal of Basic and Applied Sciences Journal home page: www.ajbasweb.com A Review on Raid Levels Implementation and Comparisons P. Sivakumar and K. Devi Department of Computer
More informationChapter 10: Mass-Storage Systems
COP 4610: Introduction to Operating Systems (Spring 2016) Chapter 10: Mass-Storage Systems Zhi Wang Florida State University Content Overview of Mass Storage Structure Disk Structure Disk Scheduling Disk
More informationUNIT 2 Data Center Environment
UNIT 2 Data Center Environment This chapter provides an understanding of various logical components of hosts such as file systems, volume managers, and operating systems, and their role in the storage
More informationDatabase Management Systems, 2nd edition, Raghu Ramakrishnan, Johannes Gehrke, McGraw-Hill
Lecture Handout Database Management System Lecture No. 34 Reading Material Database Management Systems, 2nd edition, Raghu Ramakrishnan, Johannes Gehrke, McGraw-Hill Modern Database Management, Fred McFadden,
More informationCh 11: Storage and File Structure
Ch 11: Storage and File Structure Overview of Physical Storage Media Magnetic Disks RAID Tertiary Storage Storage Access File Organization Organization of Records in Files Data-Dictionary Dictionary Storage
More informationThe x86 Microprocessors. Introduction. The 80x86 Microprocessors. 1.1 Assembly Language
The x86 Microprocessors Introduction 1.1 Assembly Language Numbering and Coding Systems Human beings use the decimal system (base 10) Decimal digits: 0, 1, 2, 3, 4, 5, 6, 7, 8, 9 Computer systems use the
More informationCS143: Disks and Files
CS143: Disks and Files 1 System Architecture CPU Word (1B 64B) ~ x GB/sec Main Memory System Bus Disk Controller... Block (512B 50KB) ~ x MB/sec Disk 2 Magnetic disk vs SSD Magnetic Disk Stores data on
More informationAdapted from instructor s supplementary material from Computer. Patterson & Hennessy, 2008, MK]
Lecture 17 Adapted from instructor s supplementary material from Computer Organization and Design, 4th Edition, Patterson & Hennessy, 2008, MK] SRAM / / Flash / RRAM / HDD SRAM / / Flash / RRAM/ HDD SRAM
More informationCS370 Operating Systems
CS370 Operating Systems Colorado State University Yashwant K Malaiya Fall 2016 Lecture 35 Mass Storage Slides based on Text by Silberschatz, Galvin, Gagne Various sources 1 1 Questions For You Local/Global
More informationChapter 6. Storage and Other I/O Topics. Jiang Jiang
Chapter 6 Storage and Other I/O Topics Jiang Jiang jiangjiang@ic.sjtu.edu.cn [Adapted from Computer Organization and Design, 4 th Edition, Patterson & Hennessy, 2008, MK] Chapter 6 Storage and Other I/O
More informationResource Management on a Mixed Processor Linux Cluster. Haibo Wang. Mississippi Center for Supercomputing Research
Resource Management on a Mixed Processor Linux Cluster Haibo Wang Mississippi Center for Supercomputing Research Many existing clusters were built as a small test-bed for small group of users and then
More informationIomega REV Drive Data Transfer Performance
Technical White Paper March 2004 Iomega REV Drive Data Transfer Performance Understanding Potential Transfer Rates and Factors Affecting Throughput Introduction Maximum Sustained Transfer Rate Burst Transfer
More informationConnectivity. Module 2.2. Copyright 2006 EMC Corporation. Do not Copy - All Rights Reserved. Connectivity - 1
Connectivity Module 2.2 2006 EMC Corporation. All rights reserved. Connectivity - 1 Connectivity Upon completion of this module, you will be able to: Describe the physical components of a networked storage
More informationComputer Architecture Computer Science & Engineering. Chapter 6. Storage and Other I/O Topics BK TP.HCM
Computer Architecture Computer Science & Engineering Chapter 6 Storage and Other I/O Topics Introduction I/O devices can be characterized by Behaviour: input, output, storage Partner: human or machine
More informationIngo Brenckmann Jochen Kirsten Storage Technology Strategists SAS EMEA Copyright 2003, SAS Institute Inc. All rights reserved.
Intelligent Storage Results from real life testing Ingo Brenckmann Jochen Kirsten Storage Technology Strategists SAS EMEA SAS Intelligent Storage components! OLAP Server! Scalable Performance Data Server!
More informationCS420: Operating Systems. Mass Storage Structure
Mass Storage Structure James Moscola Department of Physical Sciences York College of Pennsylvania Based on Operating System Concepts, 9th Edition by Silberschatz, Galvin, Gagne Overview of Mass Storage
More informationHigh-Performance Storage Systems
High-Performance Storage Systems I/O Systems Processor interrupts Cache Memory - I/O Bus Main Memory I/O Controller I/O Controller I/O Controller Disk Disk Graphics Network 2 Storage Technology Drivers
More informationCSE 120. Overview. July 27, Day 8 Input/Output. Instructor: Neil Rhodes. Hardware. Hardware. Hardware
CSE 120 July 27, 2006 Day 8 Input/Output Instructor: Neil Rhodes How hardware works Operating Systems Layer What the kernel does API What the programmer does Overview 2 Kinds Block devices: read/write
More informationChapter 10: Mass-Storage Systems
Chapter 10: Mass-Storage Systems Silberschatz, Galvin and Gagne Overview of Mass Storage Structure Magnetic disks provide bulk of secondary storage of modern computers Drives rotate at 60 to 200 times
More informationChapter 6. Storage and Other I/O Topics
Chapter 6 Storage and Other I/O Topics Introduction I/O devices can be characterized by Behavior: input, output, storage Partner: human or machine Data rate: bytes/sec, transfers/sec I/O bus connections
More informationIntroduction. Operating Systems. Outline. Hardware. I/O Device Types. Device Controllers. (done)
Introduction Operating Systems Input/Output Devices (Ch 13.3, 13.5; 14.1-14.3) One OS function is to control devices significant fraction of code (80-90% of Linux) Want all devices to be simple to use
More information14 January 2009 T10/08-018r4
To: T10 Technical Committee From: Mark Overby, NVIDIA Corporation (moverby@nvidia.com) Date: 14 January 2009 Subject: T10/08-018r4 SAT-3: NV Cache Translation Revision History Revision 0 - Initial draft
More informationLecture 13. Storage, Network and Other Peripherals
Lecture 13 Storage, Network and Other Peripherals 1 I/O Systems Processor interrupts Cache Processor & I/O Communication Memory - I/O Bus Main Memory I/O Controller I/O Controller I/O Controller Disk Disk
More information1 Overview. 2 Changes to SPC-4. T10/ revision 5
Date: 3/18/09 To: T10 Committee (SCSI) From: George Penokie (LSI) Subject: SPC-4: Cache hits and power on statistics 1 Overview There are some performance statistics relating to cache hits that would be
More informationClustering and Reclustering HEP Data in Object Databases
Clustering and Reclustering HEP Data in Object Databases Koen Holtman CERN EP division CH - Geneva 3, Switzerland We formulate principles for the clustering of data, applicable to both sequential HEP applications
More informationCSE 153 Design of Operating Systems
CSE 153 Design of Operating Systems Winter 2018 Lecture 20: File Systems (1) Disk drives OS Abstractions Applications Process File system Virtual memory Operating System CPU Hardware Disk RAM CSE 153 Lecture
More informationStoring Data: Disks and Files
Storing Data: Disks and Files Chapter 7 (2 nd edition) Chapter 9 (3 rd edition) Yea, from the table of my memory I ll wipe away all trivial fond records. -- Shakespeare, Hamlet Database Management Systems,
More informationConcepts Introduced. I/O Cannot Be Ignored. Typical Collection of I/O Devices. I/O Issues
Concepts Introduced I/O Cannot Be Ignored Assume a program requires 100 seconds, 90 seconds for accessing main memory and 10 seconds for I/O. I/O introduction magnetic disks ash memory communication with
More informationCS3600 SYSTEMS AND NETWORKS
CS3600 SYSTEMS AND NETWORKS NORTHEASTERN UNIVERSITY Lecture 9: Mass Storage Structure Prof. Alan Mislove (amislove@ccs.neu.edu) Moving-head Disk Mechanism 2 Overview of Mass Storage Structure Magnetic
More informationThe next page shows the questions asked in revision 0 of this proposal and the answers supplied by the May SCSI Working Group meeting.
T10/99-163r1 Date: 13 May 1999 To: T10 Technical Committee From: Ralph Weber, LSI Logic Alternate Member of T10 Subj: EXTENDED COPY command for SPC-2 This revision contains those changes agreed by the
More informationStorage Update and Storage Best Practices for Microsoft Server Applications. Dennis Martin President, Demartek January 2009 Copyright 2009 Demartek
Storage Update and Storage Best Practices for Microsoft Server Applications Dennis Martin President, Demartek January 2009 Copyright 2009 Demartek Agenda Introduction Storage Technologies Storage Devices
More information03-388r2 SPC-3 SBC-2 Nonvolatile caches 10 March 2004
To: T10 Technical Committee From: Rob Elliott, HP (elliott@hp.com) Date: 10 March 2004 Subject: 03-388r2 SPC-3 SBC-2 Nonvolatile caches Revision history Revision 0 (11 December 2003) First revision Revision
More informationI/O, Disks, and RAID Yi Shi Fall Xi an Jiaotong University
I/O, Disks, and RAID Yi Shi Fall 2017 Xi an Jiaotong University Goals for Today Disks How does a computer system permanently store data? RAID How to make storage both efficient and reliable? 2 What does
More informationIntroduction Disks RAID Tertiary storage. Mass Storage. CMSC 420, York College. November 21, 2006
November 21, 2006 The memory hierarchy Red = Level Access time Capacity Features Registers nanoseconds 100s of bytes fixed Cache nanoseconds 1-2 MB fixed RAM nanoseconds MBs to GBs expandable Disk milliseconds
More informationProfessor: Pete Keleher! Closures, candidate keys, canonical covers etc! Armstrong axioms!
Professor: Pete Keleher! keleher@cs.umd.edu! } Mechanisms and definitions to work with FDs! Closures, candidate keys, canonical covers etc! Armstrong axioms! } Decompositions! Loss-less decompositions,
More informationStorage and File Structure. Classification of Physical Storage Media. Physical Storage Media. Physical Storage Media
Storage and File Structure Classification of Physical Storage Media Overview of Physical Storage Media Magnetic Disks RAID Tertiary Storage Storage Access File Organization Organization of Records in Files
More informationDiscussion Week 10. TA: Kyle Dewey. Tuesday, November 29, 11
Discussion Week 10 TA: Kyle Dewey Overview TA Evaluations Project #3 PE 5.1 PE 5.3 PE 11.8 (a,c,d) PE 10.1 TA Evaluations Project #3 PE 5.1 A CPU scheduling algorithm determines an order for the execution
More informationFile. File System Implementation. Operations. Permissions and Data Layout. Storing and Accessing File Data. Opening a File
File File System Implementation Operating Systems Hebrew University Spring 2007 Sequence of bytes, with no structure as far as the operating system is concerned. The only operations are to read and write
More informationRAID SEMINAR REPORT /09/2004 Asha.P.M NO: 612 S7 ECE
RAID SEMINAR REPORT 2004 Submitted on: Submitted by: 24/09/2004 Asha.P.M NO: 612 S7 ECE CONTENTS 1. Introduction 1 2. The array and RAID controller concept 2 2.1. Mirroring 3 2.2. Parity 5 2.3. Error correcting
More informationCOS 318: Operating Systems. Storage Devices. Jaswinder Pal Singh Computer Science Department Princeton University
COS 318: Operating Systems Storage Devices Jaswinder Pal Singh Computer Science Department Princeton University http://www.cs.princeton.edu/courses/archive/fall13/cos318/ Today s Topics Magnetic disks
More informationInput/Output. Today. Next. Principles of I/O hardware & software I/O software layers Secondary storage. File systems
Input/Output Today Principles of I/O hardware & software I/O software layers Secondary storage Next File systems Operating systems and I/O Two key OS goals Control I/O devices Provide a simple, easy-to-use,
More informationIntroduction. Operating Systems. Outline. Hardware. I/O Device Types. Device Controllers. One OS function is to control devices
Introduction Operating Systems Input/Output Devices (Ch12.1-12.3, 12.7; 13.1-13.3, 13.7) One OS function is to control devices significant fraction of code (80-90% of Linux) Want all devices to be simple
More informationC has been and will always remain on top for performancecritical
Check out this link: http://spectrum.ieee.org/static/interactive-the-top-programminglanguages-2016 C has been and will always remain on top for performancecritical applications: Implementing: Databases
More informationu Covered: l Management of CPU & concurrency l Management of main memory & virtual memory u Currently --- Management of I/O devices
Where Are We? COS 318: Operating Systems Storage Devices Jaswinder Pal Singh Computer Science Department Princeton University (http://www.cs.princeton.edu/courses/cos318/) u Covered: l Management of CPU
More information