Chris Moultrie Dr. Prasad CSc 8350 [17] S. Gurumurthi, A. Sivasubramaniam, M. Kandemir, and H. Franke, "DRPM: dynamic speed control for power

Size: px
Start display at page:

Download "Chris Moultrie Dr. Prasad CSc 8350 [17] S. Gurumurthi, A. Sivasubramaniam, M. Kandemir, and H. Franke, "DRPM: dynamic speed control for power"

Transcription

1 [1] This paper outlines different strategies for a new, improved version of raid named EERaid. They were able to produce savings of 60% and 70% of the energy used in typical RAID setups while keeping the efficiency on the same level as that of DPRM. They outline different setups based on current RAID striping such as RAID 0,1,5,10,50, etc. Very informative paper with good information. [2] This paper states a high performance (approaching performance of RAID 5) algorithm that is more fault tolerant than other RAID options. This involves multiple layers of RAID controllers and a variable number of disks. One master RAID controller has multiple RAID controllers set up in RAID 5 with each secondary controller attached to disks also in RAID 5. Faster and more reliable, but not more power efficient. [3] This paper outlines a model in which a manager dolls out resources to the users based on the client's bid for services. Those who bid higher get more resources, these resources are all scaled dynamically based on current server load. Outlines a complex cost equation and some energy saving benefits such as powering down (sleeping) nodes that are not currently needed, but waking them up when they are needed. [4] FAWN attempts to conserve energy with flash memory and low powered CPUs lacking L2/ L3 cache. They claim savings of 2 orders of magnitude of power for requests versus standard magnetic drives. They also claim that with less of the CPU taken up by L2/L3 cache there is more room so more processing power for simple actions like retrieving data. [5] This paper outlines 4 approaches to reducing the power consumption by disks. The first three show no real gain, but the fourth models a drive of varying speed so that it can be sped up for periods of high activity and slowed down for periods of low activity. They show 20% drop in power usage by this method. [6] A method for using redundancy in disks while saving energy. This method employs keeping one of two drives in a low-power state until one of three conditions are met: 1. high volume of accesses, 2. when disks fail, 3. at interval periods for syncing the two disks. While they see a savings of 27-60% the major issue seems to be data integrity. If the disk holding the log of the most current changes dies before the predetermined sync time, those changes would be lost. As it is not power efficient (currently) to power drives down for less than 30 seconds [reference to come later], this means potentially long periods of time without updates losing one of the important qualities of redundancy in disks. [7] Taking a different path, this paper aims to analyze the reliability of two types of parallel disk arrays: MAID and PDC. They introduce a new model for determining the life expectancy of drives and introduce methods for saving energy and extending the life of drives at the same time. Keeping drives out of landfills and using less energy at the same time offers great promise, but nothing was implemented besides their model for determining the life of drives. [8]While not able to realize significant gains (greater than 20%) in most simulations, this article's ideas warrant a closer look into possible modifications and adoption into current disk prefetching schemes. Banking on the unquoted statistic that applications use 20% of the data available 80%

2 of the time they believe they can of energy savings of 12-26%. This seems unlikely to be the case in a real world scenario since the 20% in the buffer is not enough for all data accesses and the 20% of the time spent accessing data is not shifted to one side or the other, but interspersed randomly across the log of accesses. [9] Buffered Disks is a popular topic and in this paper the authors were able to realize power savings of 38%. The idea behind the buffered disks in this paper has four tiers. There is a main BUD controller driving the entire system, below it is the buffered cache, which is in front of the buffered disks, which all sit in front of the data disks. Writes are sent down the aforementioned path and are sent to the first available spots each time. This ensures no data is waiting for a write while there are idle drives that could process it. Data in the cache (once loaded) is almost immediately written to avoid loss and preserve integrity. [10] This paper delves into compiler based organization of data on striped disks. This enables the compiler to inspect the program, determine the best size for pieces of data and splits them across the disks in round robin fashion accordingly. The only possible drawbacks I see are bringing a fully accepted compiler to the market that does not slow down considerably compile time. The technique of allowing the compiler to arrange the disk layout is capable of being combined with DRPM and other hardware energy saving techniques for an even larger gain. [11] The authors have developed a model for determining the reliability of power saving methods in parallel disk setups. This is a very important idea that has been overlooked by many researchers. In their model they determine (using Markov process) the reliability based on factors such as switching power modes and varying RPM while leaving the model open to other methods that may come. Mean Time To Data Loss and Mean Time To Failure are both important statistics determined in this paper. This model is excellent for determining the feasibility and usefulness of a power saving scheme on parallel disks. [12] MINT is a reliability model for disks, the authors in this paper take MINT and utilize it for reliability of multi-disk arrays (specifically MAID and PDC) using common power saving features such as varying voltage frequency and multi-rpm disks. Their study results in a model useful for many parallel disk systems, using data obtained from other studies, which can determine the average lifespan of disks based on their usage and configuration. [13] This is another compiler derived energy saving technique developed to work in combination with hardware techniques for saving energy. The authors achieved the best energy savings when using DRPM in conjunction with their interprocessor code-restructuring approach that schedules the code to be executed considering the disk layout information. Inter-P-TPM had an experimental savings of 43%, which was the best of the models tested. [14] Here, the idea of utilizing multiple arms simultaneously inside of a single disk to seek data is explored in detail. Many tests and comparisons are done to determine the benefits including a cost analysis based on the prices of current parts for disks. The higher cost of the disk is then compared to the energy savings gained by using such a disk. The intra-disk parallelism here shows great promise in the simulations and modeling but such a drive has not been produced since 1980 and that disk was considered to be too costly for the benefits achieved. Real data

3 from different organizations based on their type of disk seeks was used to evaluate the performance gains of the Intra-Disk Parallelism. DASH Taxonomy was also introduced in this paper. [15] HYBUD is a hybrid of two data storage schemes, non-volatile flash storage and buffered disks. Although flash storage is expensive using a small amount of it in a buffered disk architecture will mitigate the cost and improve energy usage. Requests will first go to the flash memory, then to the buffered disks and finally the data disks. The majority of the time the data disks will be in suspended mode because much of the frequently used data will be cached in one of the storage solutions ahead of it. Flash is a good first-buffer because it has very quick read times, but has slower write times which is why it is not as good for permanent storage. [16]This paper outlines a different BUD architecture (PREBUD) where a future window is developed to gather a list of data blocks that will be accessed in the future. The buffered disks then pre-fetch the blocks that are expected to be used before they are requested, leaving the data disks to be in a low power state for longer if the future window only includes blocks that are currently on the buffer disks. This scheme also differs from other prefetching schemes in that it pre-fetches data with consideration of the energy usage it will cause. It will combine requests for data to maximize the length of time that the data disk stays in low powered mode. Buffered disks (if too busy from too many requests) may be bypassed to achieve faster data retrieval times. [17]The strategy employed in this paper is called DRPM. Dynamic RPM scaling is similar to TPM (traditional power management) in that disks power is lowered with lower usage. However, unlike TPM which only has 3 states (only 1 for data seeking): in-use, idle, and suspended, DRPM has multiple usable power states based on the amount of power given to the spindle to raise or lower RPM of the platter. While a lower RPM will lower the speed of the response to the request for data, it is the authors' contention that this is negligible and only matters for a high volume of seeks, which would then incur a higher speed of the spindle. Much time is spent analyzing the performance and power cost however not much is spent in regards to the reliability of such a system, which warrants further study. [18] This paper outlines a scheme for conserving energy based on DVS (dynamic voltage scaling) coupled with an expected retrieval time of the data. The user makes a request, and the expected answer time is calculated and the request is distributed across the disk array. If there are enough requests that the request time will not be fulfilled, then the controller will scale up the voltage to the array so that they will seek the data quicker, but if there are few requests then voltage can be scaled down. [19] Hibernator was able to realize energy savings of up to 65% versus standard RAID 5 configurations without DRPM. This system uses a corse grained approach to sleeping and waking the drives which should extend the life of the drives as there are a finite number of starts and stops that a disk can handle. This setup was also able to give soft guarantees for response times whereas DRPM and PDC were not able to come close to the requested response time. Hibernator also dynamically shifts data across the array to provide faster accesses and a more

4 balanced load to save energy. Hibernator is a very advanced, well thought out compilation of some different schemes plus some original ones. [1] D. Li and J. Wang, "EERAID: energy efficient redundant and inexpensive disk array," ACM SIGOPS European Workshop, [2] S.H. Baek, B.W. Kim, E.J. Joung, and C.W. Park, "Reliability and Performance of Hierarchical RAID with," Electronics, 2001, pp [3] J.S. Chase, D.C. Anderson, P.N. Thakar, A.M. Vahdat, and R.P. Doyle, "Managing energy and server resources in hosting centers," ACM SIGOPS Operating Systems Review, vol. 35, 2001, p [4] D. Andersen, J. Franklin, M. Kaminsky, A. Phanishayee, L. Tan, and V. Vasudevan, "FAWN: A fast array of wimpy nodes," Proceedings of the ACM SIGOPS 22nd symposium on Operating systems principles, ACM, 2009, p. 1â14. [5] E. Carrera, E. Pinheiro, and R. Bianchini, "Conserving disk energy in network servers," Proceedings of the 17th annual international conference on Supercomputing, ACM, 2003, p. 97. [6] E. Pinheiro and R. Bianchini, "Exploiting Redundancy to Conserve Energy," Energy, pp [7] S. Yin, X. Ruan, A. Manzanares, Z. Ding, J. Xie, J. Majors, and X. Qin, "Improving Reliability of Energy-Efficient Parallel Storage Systems by Disk Swapping," Structure, 2009, pp [8] A. Manzanares, K. Bellam, and X. Qin, "A Prefetching Scheme for Energy Conservation in Parallel Disk Systems," Proc. NSF Next Generation Software Program Workshop, April, [9] Z. Zong, M. Briggs, N. O'Connor, and X. Qin, "An Energy-Efficient Framework for Large- Scale Parallel Storage Systems," IEEE International Parallel and Distributed Processing Symposium, IPDPS 2007, 2007, p [10] S. Son, G. Chen, M. Kandemir, and A. Choudhary, "Exposing disk layout to compiler for reducing energy consumption of parallel disk based systems," Proceedings of the tenth ACM SIGPLAN symposium on Principles and practice of parallel programming, ACM, 2005, p [11] F. Shen, X. Qin, A. Salazar, A. Manzanares, and K. Bellam, "An Energy-Efficient Reliability Model for Parallel Disk Systems," 2009 Sixth International Conference on Information Technology: New Generations, 2009, pp [12] S. Yin, X. Ruan, A. Manzanares, and X. Qin, "How reliable are parallel disk systems when energy-saving schemes are involved," in Proc. IEEE International Conference on Cluster Computing (CLUSTER, [13] S. Woo Son, G. Chen, O. Ozturk, M. Kandemir, and A. Choudhary, "Compiler-Directed Energy Optimization for Parallel Disk Based Systems," IEEE Transactions on Parallel and Distributed Systems, vol. 18, 2007, pp [14] S. Sankar, S. Gurumurthi, and M. Stan, "Intra-disk parallelism: an idea whose time has come," ACM SIGARCH Computer Architecture News, vol. 36, 2008, p [15] M. Nijim, A. Manzanares, X. Ruan, and X. Qin, "HYBUD: An Energy-Efficient Architecture for Hybrid Parallel Disk Systems," 2009 Proceedings of 18th International Conference on Computer Communications and Networks, vol , 2009, pp [16] A. Manzanres, X. Ruan, S. Yin, M. Nijim, W. Luo, and X. Qin, "Energy-Aware Prefetching for Parallel Disk Systems: Algorithms, Models, and Evaluation," 2009 Eighth IEEE International Symposium on Network Computing and Applications, 2009, pp

5 [17] S. Gurumurthi, A. Sivasubramaniam, M. Kandemir, and H. Franke, "DRPM: dynamic speed control for power management in server class disks," Proceedings of the 30th annual international symposium on Computer architecture, ACM, 2003, p [18] M. Nijim, A. Manzanares, and X. Qin, "An Adaptive Energy-Conserving Strategy for Parallel Disk Systems," th IEEE/ACM International Symposium on Distributed Simulation and Real-Time Applications, 2008, pp [19] Q. Zhu, Z. Chen, L. Tan, Y. Zhou, K. Keeton, and J. Wilkes, "Hibernator: helping disk arrays sleep through the winter," Proceedings of the twentieth ACM symposium on Operating systems principles, ACM, 2005, p. 190.

Energy-Aware Prefetching for Parallel Disk Systems

Energy-Aware Prefetching for Parallel Disk Systems 2009 Eighth IEEE International Symposium on Network Computing and Applications Energy-Aware Prefetching for Parallel Disk Systems Algorithms, Models, and Evaluation Adam Manzanres, Xiaoun Ruan, Shu Yin,

More information

Storage Devices for Database Systems

Storage Devices for Database Systems Storage Devices for Database Systems 5DV120 Database System Principles Umeå University Department of Computing Science Stephen J. Hegner hegner@cs.umu.se http://www.cs.umu.se/~hegner Storage Devices for

More information

Contents. Memory System Overview Cache Memory. Internal Memory. Virtual Memory. Memory Hierarchy. Registers In CPU Internal or Main memory

Contents. Memory System Overview Cache Memory. Internal Memory. Virtual Memory. Memory Hierarchy. Registers In CPU Internal or Main memory Memory Hierarchy Contents Memory System Overview Cache Memory Internal Memory External Memory Virtual Memory Memory Hierarchy Registers In CPU Internal or Main memory Cache RAM External memory Backing

More information

Energy Conservation In Computational Grids

Energy Conservation In Computational Grids Energy Conservation In Computational Grids Monika Yadav 1 and Sudheer Katta 2 and M. R. Bhujade 3 1 Department of Computer Science and Engineering, IIT Bombay monika@cse.iitb.ac.in 2 Department of Electrical

More information

Power and Locality Aware Request Distribution Technical Report Heungki Lee, Gopinath Vageesan and Eun Jung Kim Texas A&M University College Station

Power and Locality Aware Request Distribution Technical Report Heungki Lee, Gopinath Vageesan and Eun Jung Kim Texas A&M University College Station Power and Locality Aware Request Distribution Technical Report Heungki Lee, Gopinath Vageesan and Eun Jung Kim Texas A&M University College Station Abstract With the growing use of cluster systems in file

More information

Dynamic Power-Aware Disk Storage Management in Database Servers

Dynamic Power-Aware Disk Storage Management in Database Servers Dynamic Power-Aware Disk Storage Management in Database Servers Peyman Behzadnia 1, Wei Yuan 2, Bo Zeng 3, Yi-Cheng Tu 1( ), and Xiaorui Wang 4 1 Department of Computer Science and Engineering, University

More information

CSCI-GA Operating Systems. I/O : Disk Scheduling and RAID. Hubertus Franke

CSCI-GA Operating Systems. I/O : Disk Scheduling and RAID. Hubertus Franke CSCI-GA.2250-001 Operating Systems I/O : Disk Scheduling and RAID Hubertus Franke frankeh@cs.nyu.edu Disks Scheduling Abstracted by OS as files A Conventional Hard Disk (Magnetic) Structure Hard Disk

More information

MIND: A Black-Box Energy Consumption Model for Disk Arrays

MIND: A Black-Box Energy Consumption Model for Disk Arrays MIND: A Black-Box Energy Consumption Model for Disk Arrays Zhuo Liu 1,2, Jian Zhou 1, Weikuan Yu 2, Fei Wu 1, Xiao Qin 2, and Changsheng Xie 1 1 Wuhan National Laboratory for Optoelectronics 1 Key Laboratory

More information

Database Management Systems, 2nd edition, Raghu Ramakrishnan, Johannes Gehrke, McGraw-Hill

Database Management Systems, 2nd edition, Raghu Ramakrishnan, Johannes Gehrke, McGraw-Hill Lecture Handout Database Management System Lecture No. 34 Reading Material Database Management Systems, 2nd edition, Raghu Ramakrishnan, Johannes Gehrke, McGraw-Hill Modern Database Management, Fred McFadden,

More information

Software-Directed Disk Power Management for Scientific Applications

Software-Directed Disk Power Management for Scientific Applications Software-Directed Disk Power Management for Scientific Applications S. W. Son M. Kandemir CSE Department Pennsylvania State University University Park, PA 16802, USA {sson,kandemir}@cse.psu.edu A. Choudhary

More information

Chapter 6 - External Memory

Chapter 6 - External Memory Chapter 6 - External Memory Luis Tarrataca luis.tarrataca@gmail.com CEFET-RJ L. Tarrataca Chapter 6 - External Memory 1 / 66 Table of Contents I 1 Motivation 2 Magnetic Disks Write Mechanism Read Mechanism

More information

Database Systems II. Secondary Storage

Database Systems II. Secondary Storage Database Systems II Secondary Storage CMPT 454, Simon Fraser University, Fall 2009, Martin Ester 29 The Memory Hierarchy Swapping, Main-memory DBMS s Tertiary Storage: Tape, Network Backup 3,200 MB/s (DDR-SDRAM

More information

Lecture 23: Storage Systems. Topics: disk access, bus design, evaluation metrics, RAID (Sections )

Lecture 23: Storage Systems. Topics: disk access, bus design, evaluation metrics, RAID (Sections ) Lecture 23: Storage Systems Topics: disk access, bus design, evaluation metrics, RAID (Sections 7.1-7.9) 1 Role of I/O Activities external to the CPU are typically orders of magnitude slower Example: while

More information

HyBuM: Energy-Efficient Hybrid Mobile Storage Systems using Solid States and Buffer Disks Mais Nijim (corresponding author), Ashraf yaseen

HyBuM: Energy-Efficient Hybrid Mobile Storage Systems using Solid States and Buffer Disks Mais Nijim (corresponding author), Ashraf yaseen Computer Communication & Collaboration (Vol. 3, Issue 4, 2015) ISSN 2292-1028(Print) 2292-1036(Online) Submitted on Aug. 31, 2015 (DOIC: 2292-1036-2015-04-001-59) HyBuM: Energy-Efficient Hybrid Mobile

More information

I/O CANNOT BE IGNORED

I/O CANNOT BE IGNORED LECTURE 13 I/O I/O CANNOT BE IGNORED Assume a program requires 100 seconds, 90 seconds for main memory, 10 seconds for I/O. Assume main memory access improves by ~10% per year and I/O remains the same.

More information

Automated Storage Tiering on Infortrend s ESVA Storage Systems

Automated Storage Tiering on Infortrend s ESVA Storage Systems Automated Storage Tiering on Infortrend s ESVA Storage Systems White paper Abstract This white paper introduces automated storage tiering on Infortrend s ESVA storage arrays. Storage tiering can generate

More information

Virtual Memory. Reading. Sections 5.4, 5.5, 5.6, 5.8, 5.10 (2) Lecture notes from MKP and S. Yalamanchili

Virtual Memory. Reading. Sections 5.4, 5.5, 5.6, 5.8, 5.10 (2) Lecture notes from MKP and S. Yalamanchili Virtual Memory Lecture notes from MKP and S. Yalamanchili Sections 5.4, 5.5, 5.6, 5.8, 5.10 Reading (2) 1 The Memory Hierarchy ALU registers Cache Memory Memory Memory Managed by the compiler Memory Managed

More information

A New High-performance, Energy-efficient Replication Storage System with Reliability Guarantee

A New High-performance, Energy-efficient Replication Storage System with Reliability Guarantee A New High-performance, Energy-efficient Replication Storage System with Reliability Guarantee Jiguang Wan 1, Chao Yin 1, Jun Wang 2 and Changsheng Xie 1 1 Wuhan National Laboratory for Optoelectronics,

More information

Data Storage and Query Answering. Data Storage and Disk Structure (2)

Data Storage and Query Answering. Data Storage and Disk Structure (2) Data Storage and Query Answering Data Storage and Disk Structure (2) Review: The Memory Hierarchy Swapping, Main-memory DBMS s Tertiary Storage: Tape, Network Backup 3,200 MB/s (DDR-SDRAM @200MHz) 6,400

More information

Chapter 1: Introduction. Operating System Concepts 9 th Edit9on

Chapter 1: Introduction. Operating System Concepts 9 th Edit9on Chapter 1: Introduction Operating System Concepts 9 th Edit9on Silberschatz, Galvin and Gagne 2013 Objectives To describe the basic organization of computer systems To provide a grand tour of the major

More information

Administrivia. CMSC 411 Computer Systems Architecture Lecture 19 Storage Systems, cont. Disks (cont.) Disks - review

Administrivia. CMSC 411 Computer Systems Architecture Lecture 19 Storage Systems, cont. Disks (cont.) Disks - review Administrivia CMSC 411 Computer Systems Architecture Lecture 19 Storage Systems, cont. Homework #4 due Thursday answers posted soon after Exam #2 on Thursday, April 24 on memory hierarchy (Unit 4) and

More information

Lecture 25: Interconnection Networks, Disks. Topics: flow control, router microarchitecture, RAID

Lecture 25: Interconnection Networks, Disks. Topics: flow control, router microarchitecture, RAID Lecture 25: Interconnection Networks, Disks Topics: flow control, router microarchitecture, RAID 1 Virtual Channel Flow Control Each switch has multiple virtual channels per phys. channel Each virtual

More information

FAWN. A Fast Array of Wimpy Nodes. David Andersen, Jason Franklin, Michael Kaminsky*, Amar Phanishayee, Lawrence Tan, Vijay Vasudevan

FAWN. A Fast Array of Wimpy Nodes. David Andersen, Jason Franklin, Michael Kaminsky*, Amar Phanishayee, Lawrence Tan, Vijay Vasudevan FAWN A Fast Array of Wimpy Nodes David Andersen, Jason Franklin, Michael Kaminsky*, Amar Phanishayee, Lawrence Tan, Vijay Vasudevan Carnegie Mellon University *Intel Labs Pittsburgh Energy in computing

More information

RAID SEMINAR REPORT /09/2004 Asha.P.M NO: 612 S7 ECE

RAID SEMINAR REPORT /09/2004 Asha.P.M NO: 612 S7 ECE RAID SEMINAR REPORT 2004 Submitted on: Submitted by: 24/09/2004 Asha.P.M NO: 612 S7 ECE CONTENTS 1. Introduction 1 2. The array and RAID controller concept 2 2.1. Mirroring 3 2.2. Parity 5 2.3. Error correcting

More information

CS5460: Operating Systems Lecture 20: File System Reliability

CS5460: Operating Systems Lecture 20: File System Reliability CS5460: Operating Systems Lecture 20: File System Reliability File System Optimizations Modern Historic Technique Disk buffer cache Aggregated disk I/O Prefetching Disk head scheduling Disk interleaving

More information

A Reliable B-Tree Implementation over Flash Memory

A Reliable B-Tree Implementation over Flash Memory A Reliable B-Tree Implementation over Flash Xiaoyan Xiang, Lihua Yue, Zhanzhan Liu, Peng Wei Department of Computer Science and Technology University of Science and Technology of China, Hefei, P.R.China

More information

C 1. Recap. CSE 486/586 Distributed Systems Distributed File Systems. Traditional Distributed File Systems. Local File Systems.

C 1. Recap. CSE 486/586 Distributed Systems Distributed File Systems. Traditional Distributed File Systems. Local File Systems. Recap CSE 486/586 Distributed Systems Distributed File Systems Optimistic quorum Distributed transactions with replication One copy serializability Primary copy replication Read-one/write-all replication

More information

Fangyang Shen* and Andres Salazar

Fangyang Shen* and Andres Salazar 240 Int. J. High Performance Systems Architecture, Vol. 2, Nos. 3/4, 2010 A reliability model of energy-efficient parallel disk systems with data mirroring Fangyang Shen* and Andres Salazar Department

More information

RAID. Redundant Array of Inexpensive Disks. Industry tends to use Independent Disks

RAID. Redundant Array of Inexpensive Disks. Industry tends to use Independent Disks RAID Chapter 5 1 RAID Redundant Array of Inexpensive Disks Industry tends to use Independent Disks Idea: Use multiple disks to parallelise Disk I/O for better performance Use multiple redundant disks for

More information

BBM371- Data Management. Lecture 2: Storage Devices

BBM371- Data Management. Lecture 2: Storage Devices BBM371- Data Management Lecture 2: Storage Devices 18.10.2018 Memory Hierarchy cache Main memory disk Optical storage Tapes V NV Traveling the hierarchy: 1. speed ( higher=faster) 2. cost (lower=cheaper)

More information

Operating system Dr. Shroouq J.

Operating system Dr. Shroouq J. 2.2.2 DMA Structure In a simple terminal-input driver, when a line is to be read from the terminal, the first character typed is sent to the computer. When that character is received, the asynchronous-communication

More information

ECE Enterprise Storage Architecture. Fall 2018

ECE Enterprise Storage Architecture. Fall 2018 ECE590-03 Enterprise Storage Architecture Fall 2018 RAID Tyler Bletsch Duke University Slides include material from Vince Freeh (NCSU) A case for redundant arrays of inexpensive disks Circa late 80s..

More information

I/O Hardwares. Some typical device, network, and data base rates

I/O Hardwares. Some typical device, network, and data base rates Input/Output 1 I/O Hardwares Some typical device, network, and data base rates 2 Device Controllers I/O devices have components: mechanical component electronic component The electronic component is the

More information

Delayed Partial Parity Scheme for Reliable and High-Performance Flash Memory SSD

Delayed Partial Parity Scheme for Reliable and High-Performance Flash Memory SSD Delayed Partial Parity Scheme for Reliable and High-Performance Flash Memory SSD Soojun Im School of ICE Sungkyunkwan University Suwon, Korea Email: lang33@skku.edu Dongkun Shin School of ICE Sungkyunkwan

More information

FAWN as a Service. 1 Introduction. Jintian Liang CS244B December 13, 2017

FAWN as a Service. 1 Introduction. Jintian Liang CS244B December 13, 2017 Liang 1 Jintian Liang CS244B December 13, 2017 1 Introduction FAWN as a Service FAWN, an acronym for Fast Array of Wimpy Nodes, is a distributed cluster of inexpensive nodes designed to give users a view

More information

k -bit address bus n-bit data bus Control lines ( R W, MFC, etc.)

k -bit address bus n-bit data bus Control lines ( R W, MFC, etc.) THE MEMORY SYSTEM SOME BASIC CONCEPTS Maximum size of the Main Memory byte-addressable CPU-Main Memory Connection, Processor MAR MDR k -bit address bus n-bit data bus Memory Up to 2 k addressable locations

More information

Advanced Database Systems

Advanced Database Systems Lecture II Storage Layer Kyumars Sheykh Esmaili Course s Syllabus Core Topics Storage Layer Query Processing and Optimization Transaction Management and Recovery Advanced Topics Cloud Computing and Web

More information

SF-LRU Cache Replacement Algorithm

SF-LRU Cache Replacement Algorithm SF-LRU Cache Replacement Algorithm Jaafar Alghazo, Adil Akaaboune, Nazeih Botros Southern Illinois University at Carbondale Department of Electrical and Computer Engineering Carbondale, IL 6291 alghazo@siu.edu,

More information

Dynamic Buffer Allocation for Conserving Disk Energy in Clustered Video Servers Which Use Replication

Dynamic Buffer Allocation for Conserving Disk Energy in Clustered Video Servers Which Use Replication Dynamic Buffer Allocation for Conserving Dis Energy in Clustered Video Servers Which Use Replication Minseo Song School of Computer Science and Engineering, Inha University, Korea mong@inha.ac.r Abstract.

More information

Chapter 1: Introduction. Operating System Concepts 8th Edition,

Chapter 1: Introduction. Operating System Concepts 8th Edition, Chapter 1: Introduction, Administrivia Reading: Chapter 1. Next time: Continued Grand Tour. 1.2 Outline Common computer system devices. Parallelism within an operating system. Interrupts. Storage operation,

More information

Lecture 29. Friday, March 23 CS 470 Operating Systems - Lecture 29 1

Lecture 29. Friday, March 23 CS 470 Operating Systems - Lecture 29 1 Lecture 29 Reminder: Homework 7 is due on Monday at class time for Exam 2 review; no late work accepted. Reminder: Exam 2 is on Wednesday. Exam 2 review sheet is posted. Questions? Friday, March 23 CS

More information

I/O Management and Disk Scheduling. Chapter 11

I/O Management and Disk Scheduling. Chapter 11 I/O Management and Disk Scheduling Chapter 11 Categories of I/O Devices Human readable used to communicate with the user video display terminals keyboard mouse printer Categories of I/O Devices Machine

More information

Input/Output Management

Input/Output Management Chapter 11 Input/Output Management This could be the messiest aspect of an operating system. There are just too much stuff involved, it is difficult to develop a uniform and consistent theory to cover

More information

Is Traditional Power Management + Prefetching == DRPM for Server Disks?

Is Traditional Power Management + Prefetching == DRPM for Server Disks? Is Traditional Power Management + Prefetching == DRPM for Server Disks? Vivek Natarajan Sudhanva Gurumurthi Anand Sivasubramaniam Department of Computer Science and Engineering, The Pennsylvania State

More information

Announcement. Computer Architecture (CSC-3501) Lecture 20 (08 April 2008) Chapter 6 Objectives. 6.1 Introduction. 6.

Announcement. Computer Architecture (CSC-3501) Lecture 20 (08 April 2008) Chapter 6 Objectives. 6.1 Introduction. 6. Announcement Computer Architecture (CSC-350) Lecture 0 (08 April 008) Seung-Jong Park (Jay) http://www.csc.lsu.edu/~sjpark Chapter 6 Objectives 6. Introduction Master the concepts of hierarchical memory

More information

Dynamic Compilation for Reducing Energy Consumption of I/O-Intensive Applications

Dynamic Compilation for Reducing Energy Consumption of I/O-Intensive Applications Dynamic Compilation for Reducing Energy Consumption of I/O-Intensive Applications Seung Woo Son 1, Guangyu Chen 1, Mahmut Kandemir 1, and Alok Choudhary 2 1 Pennsylvania State University, University Park

More information

Virtual Machines. 2 Disco: Running Commodity Operating Systems on Scalable Multiprocessors([1])

Virtual Machines. 2 Disco: Running Commodity Operating Systems on Scalable Multiprocessors([1]) EE392C: Advanced Topics in Computer Architecture Lecture #10 Polymorphic Processors Stanford University Thursday, 8 May 2003 Virtual Machines Lecture #10: Thursday, 1 May 2003 Lecturer: Jayanth Gummaraju,

More information

Appendix D: Storage Systems

Appendix D: Storage Systems Appendix D: Storage Systems Instructor: Josep Torrellas CS433 Copyright Josep Torrellas 1999, 2001, 2002, 2013 1 Storage Systems : Disks Used for long term storage of files temporarily store parts of pgm

More information

Software Pipelining for Coarse-Grained Reconfigurable Instruction Set Processors

Software Pipelining for Coarse-Grained Reconfigurable Instruction Set Processors Software Pipelining for Coarse-Grained Reconfigurable Instruction Set Processors Francisco Barat, Murali Jayapala, Pieter Op de Beeck and Geert Deconinck K.U.Leuven, Belgium. {f-barat, j4murali}@ieee.org,

More information

Professor: Pete Keleher! Closures, candidate keys, canonical covers etc! Armstrong axioms!

Professor: Pete Keleher! Closures, candidate keys, canonical covers etc! Armstrong axioms! Professor: Pete Keleher! keleher@cs.umd.edu! } Mechanisms and definitions to work with FDs! Closures, candidate keys, canonical covers etc! Armstrong axioms! } Decompositions! Loss-less decompositions,

More information

Computer Architecture 计算机体系结构. Lecture 6. Data Storage and I/O 第六讲 数据存储和输入输出. Chao Li, PhD. 李超博士

Computer Architecture 计算机体系结构. Lecture 6. Data Storage and I/O 第六讲 数据存储和输入输出. Chao Li, PhD. 李超博士 Computer Architecture 计算机体系结构 Lecture 6. Data Storage and I/O 第六讲 数据存储和输入输出 Chao Li, PhD. 李超博士 SJTU-SE346, Spring 2018 Review Memory hierarchy Cache and virtual memory Locality principle Miss cache, victim

More information

Storage Systems. Storage Systems

Storage Systems. Storage Systems Storage Systems Storage Systems We already know about four levels of storage: Registers Cache Memory Disk But we've been a little vague on how these devices are interconnected In this unit, we study Input/output

More information

Performance of relational database management

Performance of relational database management Building a 3-D DRAM Architecture for Optimum Cost/Performance By Gene Bowles and Duke Lambert As systems increase in performance and power, magnetic disk storage speeds have lagged behind. But using solidstate

More information

5.11 Parallelism and Memory Hierarchy: Redundant Arrays of Inexpensive Disks 485.e1

5.11 Parallelism and Memory Hierarchy: Redundant Arrays of Inexpensive Disks 485.e1 5.11 Parallelism and Memory Hierarchy: Redundant Arrays of Inexpensive Disks 485.e1 5.11 Parallelism and Memory Hierarchy: Redundant Arrays of Inexpensive Disks Amdahl s law in Chapter 1 reminds us that

More information

CMSC 424 Database design Lecture 12 Storage. Mihai Pop

CMSC 424 Database design Lecture 12 Storage. Mihai Pop CMSC 424 Database design Lecture 12 Storage Mihai Pop Administrative Office hours tomorrow @ 10 Midterms are in solutions for part C will be posted later this week Project partners I have an odd number

More information

Demand fetching is commonly employed to bring the data

Demand fetching is commonly employed to bring the data Proceedings of 2nd Annual Conference on Theoretical and Applied Computer Science, November 2010, Stillwater, OK 14 Markov Prediction Scheme for Cache Prefetching Pranav Pathak, Mehedi Sarwar, Sohum Sohoni

More information

COMP283-Lecture 3 Applied Database Management

COMP283-Lecture 3 Applied Database Management COMP283-Lecture 3 Applied Database Management Introduction DB Design Continued Disk Sizing Disk Types & Controllers DB Capacity 1 COMP283-Lecture 3 DB Storage: Linear Growth Disk space requirements increases

More information

Storage systems. Computer Systems Architecture CMSC 411 Unit 6 Storage Systems. (Hard) Disks. Disk and Tape Technologies. Disks (cont.

Storage systems. Computer Systems Architecture CMSC 411 Unit 6 Storage Systems. (Hard) Disks. Disk and Tape Technologies. Disks (cont. Computer Systems Architecture CMSC 4 Unit 6 Storage Systems Alan Sussman November 23, 2004 Storage systems We already know about four levels of storage: registers cache memory disk but we've been a little

More information

Fundamentals of Quantitative Design and Analysis

Fundamentals of Quantitative Design and Analysis Fundamentals of Quantitative Design and Analysis Dr. Jiang Li Adapted from the slides provided by the authors Computer Technology Performance improvements: Improvements in semiconductor technology Feature

More information

I/O CANNOT BE IGNORED

I/O CANNOT BE IGNORED LECTURE 13 I/O I/O CANNOT BE IGNORED Assume a program requires 100 seconds, 90 seconds for main memory, 10 seconds for I/O. Assume main memory access improves by ~10% per year and I/O remains the same.

More information

RAID (Redundant Array of Inexpensive Disks)

RAID (Redundant Array of Inexpensive Disks) Magnetic Disk Characteristics I/O Connection Structure Types of Buses Cache & I/O I/O Performance Metrics I/O System Modeling Using Queuing Theory Designing an I/O System RAID (Redundant Array of Inexpensive

More information

Monday, May 4, Discs RAID: Introduction Error detection and correction Error detection: Simple parity Error correction: Hamming Codes

Monday, May 4, Discs RAID: Introduction Error detection and correction Error detection: Simple parity Error correction: Hamming Codes Monday, May 4, 2015 Topics for today Secondary memory Discs RAID: Introduction Error detection and correction Error detection: Simple parity Error correction: Hamming Codes Storage management (Chapter

More information

The Use of Cloud Computing Resources in an HPC Environment

The Use of Cloud Computing Resources in an HPC Environment The Use of Cloud Computing Resources in an HPC Environment Bill, Labate, UCLA Office of Information Technology Prakashan Korambath, UCLA Institute for Digital Research & Education Cloud computing becomes

More information

Linux Software RAID Level 0 Technique for High Performance Computing by using PCI-Express based SSD

Linux Software RAID Level 0 Technique for High Performance Computing by using PCI-Express based SSD Linux Software RAID Level Technique for High Performance Computing by using PCI-Express based SSD Jae Gi Son, Taegyeong Kim, Kuk Jin Jang, *Hyedong Jung Department of Industrial Convergence, Korea Electronics

More information

Department of Information Technology Sri Venkateshwara College of Engineering, Chennai, India. 1 2

Department of Information Technology Sri Venkateshwara College of Engineering, Chennai, India. 1 2 Energy-Aware Scheduling Using Workload Consolidation Techniques in Cloud Environment 1 Sridharshini V, 2 V.M.Sivagami 1 PG Scholar, 2 Associate Professor Department of Information Technology Sri Venkateshwara

More information

ECE331: Hardware Organization and Design

ECE331: Hardware Organization and Design ECE331: Hardware Organization and Design Lecture 29: an Introduction to Virtual Memory Adapted from Computer Organization and Design, Patterson & Hennessy, UCB Overview Virtual memory used to protect applications

More information

EDUCATION RESEARCH EXPERIENCE

EDUCATION RESEARCH EXPERIENCE PERSONAL Name: Mais Nijim Gender: Female Address: 901 walkway, apartment A1 Socorro, NM 87801 Email: mais@cs.nmt.edu Phone: (505)517-0150 (505)650-0400 RESEARCH INTEREST Computer Architecture Storage Systems

More information

CPSC 421 Database Management Systems. Lecture 11: Storage and File Organization

CPSC 421 Database Management Systems. Lecture 11: Storage and File Organization CPSC 421 Database Management Systems Lecture 11: Storage and File Organization * Some material adapted from R. Ramakrishnan, L. Delcambre, and B. Ludaescher Today s Agenda Start on Database Internals:

More information

Lecture 18: Memory Systems. Spring 2018 Jason Tang

Lecture 18: Memory Systems. Spring 2018 Jason Tang Lecture 18: Memory Systems Spring 2018 Jason Tang 1 Topics Memory hierarchy Memory operations Cache basics 2 Computer Organization Computer Processor Memory Devices Control Datapath Input Output So far,

More information

A Data Centered Approach for Cache Partitioning in Embedded Real- Time Database System

A Data Centered Approach for Cache Partitioning in Embedded Real- Time Database System A Data Centered Approach for Cache Partitioning in Embedded Real- Time Database System HU WEI, CHEN TIANZHOU, SHI QINGSONG, JIANG NING College of Computer Science Zhejiang University College of Computer

More information

Chapter 11. I/O Management and Disk Scheduling

Chapter 11. I/O Management and Disk Scheduling Operating System Chapter 11. I/O Management and Disk Scheduling Lynn Choi School of Electrical Engineering Categories of I/O Devices I/O devices can be grouped into 3 categories Human readable devices

More information

Eastern Mediterranean University School of Computing and Technology CACHE MEMORY. Computer memory is organized into a hierarchy.

Eastern Mediterranean University School of Computing and Technology CACHE MEMORY. Computer memory is organized into a hierarchy. Eastern Mediterranean University School of Computing and Technology ITEC255 Computer Organization & Architecture CACHE MEMORY Introduction Computer memory is organized into a hierarchy. At the highest

More information

Memory. Objectives. Introduction. 6.2 Types of Memory

Memory. Objectives. Introduction. 6.2 Types of Memory Memory Objectives Master the concepts of hierarchical memory organization. Understand how each level of memory contributes to system performance, and how the performance is measured. Master the concepts

More information

Chapter 6 Objectives

Chapter 6 Objectives Chapter 6 Memory Chapter 6 Objectives Basic memory concepts, such as RAM and the various memory devices Master the concepts of hierarchical memory organization. Understand how each level of memory contributes

More information

Real-time grid computing for financial applications

Real-time grid computing for financial applications CNR-INFM Democritos and EGRID project E-mail: cozzini@democritos.it Riccardo di Meo, Ezio Corso EGRID project ICTP E-mail: {dimeo,ecorso}@egrid.it We describe the porting of a test case financial application

More information

Dynamic Data Placement Strategy in MapReduce-styled Data Processing Platform Hua-Ci WANG 1,a,*, Cai CHEN 2,b,*, Yi LIANG 3,c

Dynamic Data Placement Strategy in MapReduce-styled Data Processing Platform Hua-Ci WANG 1,a,*, Cai CHEN 2,b,*, Yi LIANG 3,c 2016 Joint International Conference on Service Science, Management and Engineering (SSME 2016) and International Conference on Information Science and Technology (IST 2016) ISBN: 978-1-60595-379-3 Dynamic

More information

Chapter 11: File System Implementation. Objectives

Chapter 11: File System Implementation. Objectives Chapter 11: File System Implementation Objectives To describe the details of implementing local file systems and directory structures To describe the implementation of remote file systems To discuss block

More information

Database Systems. November 2, 2011 Lecture #7. topobo (mit)

Database Systems. November 2, 2011 Lecture #7. topobo (mit) Database Systems November 2, 2011 Lecture #7 1 topobo (mit) 1 Announcement Assignment #2 due today Assignment #3 out today & due on 11/16. Midterm exam in class next week. Cover Chapters 1, 2,

More information

File Structures and Indexing

File Structures and Indexing File Structures and Indexing CPS352: Database Systems Simon Miner Gordon College Last Revised: 10/11/12 Agenda Check-in Database File Structures Indexing Database Design Tips Check-in Database File Structures

More information

ECE7995 (3) Basis of Caching and Prefetching --- Locality

ECE7995 (3) Basis of Caching and Prefetching --- Locality ECE7995 (3) Basis of Caching and Prefetching --- Locality 1 What s locality? Temporal locality is a property inherent to programs and independent of their execution environment. Temporal locality: the

More information

Associate Professor Dr. Raed Ibraheem Hamed

Associate Professor Dr. Raed Ibraheem Hamed Associate Professor Dr. Raed Ibraheem Hamed University of Human Development, College of Science and Technology Computer Science Department 2015 2016 1 Points to Cover Storing Data in a DBMS Primary Storage

More information

Che-Wei Chang Department of Computer Science and Information Engineering, Chang Gung University

Che-Wei Chang Department of Computer Science and Information Engineering, Chang Gung University Che-Wei Chang chewei@mail.cgu.edu.tw Department of Computer Science and Information Engineering, Chang Gung University l Chapter 10: File System l Chapter 11: Implementing File-Systems l Chapter 12: Mass-Storage

More information

Baoping Wang School of software, Nanyang Normal University, Nanyang , Henan, China

Baoping Wang School of software, Nanyang Normal University, Nanyang , Henan, China doi:10.21311/001.39.7.41 Implementation of Cache Schedule Strategy in Solid-state Disk Baoping Wang School of software, Nanyang Normal University, Nanyang 473061, Henan, China Chao Yin* School of Information

More information

Wednesday, April 25, Discs RAID: Introduction Error detection and correction Error detection: Simple parity Error correction: Hamming Codes

Wednesday, April 25, Discs RAID: Introduction Error detection and correction Error detection: Simple parity Error correction: Hamming Codes Wednesday, April 25, 2018 Topics for today Secondary memory Discs RAID: Introduction Error detection and correction Error detection: Simple parity Error correction: Hamming Codes Storage management (Chapter

More information

UNIT I (Two Marks Questions & Answers)

UNIT I (Two Marks Questions & Answers) UNIT I (Two Marks Questions & Answers) Discuss the different ways how instruction set architecture can be classified? Stack Architecture,Accumulator Architecture, Register-Memory Architecture,Register-

More information

Leveraging Disk Drive Acoustic Modes for Power Management

Leveraging Disk Drive Acoustic Modes for Power Management 1 Leveraging Disk Drive Acoustic Modes for Power Management Doron Chen, George Goldberg, Roger Kahn, Ronen I. Kat, Kalman Meth {cdoron,georgeg,rogerk,ronenkat,meth}@il.ibm.com IBM Research - Haifa, Israel

More information

A Data Centered Approach for Cache Partitioning in Embedded Real- Time Database System

A Data Centered Approach for Cache Partitioning in Embedded Real- Time Database System A Data Centered Approach for Cache Partitioning in Embedded Real- Time Database System HU WEI CHEN TIANZHOU SHI QINGSONG JIANG NING College of Computer Science Zhejiang University College of Computer Science

More information

Introduction to Parallel Processing

Introduction to Parallel Processing Babylon University College of Information Technology Software Department Introduction to Parallel Processing By Single processor supercomputers have achieved great speeds and have been pushing hardware

More information

CS 525M Mobile and Ubiquitous Computing Seminar. Michael Theriault

CS 525M Mobile and Ubiquitous Computing Seminar. Michael Theriault CS 525M Mobile and Ubiquitous Computing Seminar Michael Theriault Software Strategies for Portable Computer Energy Management Paper by Jacob R. Lorch and Alan J. Smith at the University of California In

More information

All-Flash Storage Solution for SAP HANA:

All-Flash Storage Solution for SAP HANA: All-Flash Storage Solution for SAP HANA: Storage Considerations using SanDisk Solid State Devices WHITE PAPER Western Digital Technologies, Inc. 951 SanDisk Drive, Milpitas, CA 95035 www.sandisk.com Table

More information

Storing Data: Disks and Files. Storing and Retrieving Data. Why Not Store Everything in Main Memory? Chapter 7

Storing Data: Disks and Files. Storing and Retrieving Data. Why Not Store Everything in Main Memory? Chapter 7 Storing : Disks and Files Chapter 7 base Management Systems, R. Ramakrishnan and J. Gehrke 1 Storing and Retrieving base Management Systems need to: Store large volumes of data Store data reliably (so

More information

Principles of Data Management. Lecture #2 (Storing Data: Disks and Files)

Principles of Data Management. Lecture #2 (Storing Data: Disks and Files) Principles of Data Management Lecture #2 (Storing Data: Disks and Files) Instructor: Mike Carey mjcarey@ics.uci.edu Database Management Systems 3ed, R. Ramakrishnan and J. Gehrke 1 Today s Topics v Today

More information

How to Apply the Geospatial Data Abstraction Library (GDAL) Properly to Parallel Geospatial Raster I/O?

How to Apply the Geospatial Data Abstraction Library (GDAL) Properly to Parallel Geospatial Raster I/O? bs_bs_banner Short Technical Note Transactions in GIS, 2014, 18(6): 950 957 How to Apply the Geospatial Data Abstraction Library (GDAL) Properly to Parallel Geospatial Raster I/O? Cheng-Zhi Qin,* Li-Jun

More information

William Stallings Computer Organization and Architecture 8th Edition. Cache Memory

William Stallings Computer Organization and Architecture 8th Edition. Cache Memory William Stallings Computer Organization and Architecture 8th Edition Chapter 4 Cache Memory Characteristics Location Capacity Unit of transfer Access method Performance Physical type Physical characteristics

More information

Introduction to I/O. April 30, Howard Huang 1

Introduction to I/O. April 30, Howard Huang 1 Introduction to I/O Where does the data for our CPU and memory come from or go to? Computers communicate with the outside world via I/O devices. Input devices supply computers with data to operate on.

More information

ELE580A: Green Information Technology (Fall 2010) Instructor: Professor Margaret Martonosi

ELE580A: Green Information Technology (Fall 2010) Instructor: Professor Margaret Martonosi ELE580A: Green Information Technology (Fall 2010) Instructor: Professor Margaret Martonosi mrm@princeton.edu Where to find stuff: All course information, schedule, and links to class readings will be available

More information

Storing and Retrieving Data. Storing Data: Disks and Files. Solution 1: Techniques for making disks faster. Disks. Why Not Store Everything in Tapes?

Storing and Retrieving Data. Storing Data: Disks and Files. Solution 1: Techniques for making disks faster. Disks. Why Not Store Everything in Tapes? Storing and Retrieving Storing : Disks and Files Chapter 9 base Management Systems need to: Store large volumes of data Store data reliably (so that data is not lost!) Retrieve data efficiently Alternatives

More information

A+ Guide to Hardware: Managing, Maintaining, and Troubleshooting, 5e. Chapter 6 Supporting Hard Drives

A+ Guide to Hardware: Managing, Maintaining, and Troubleshooting, 5e. Chapter 6 Supporting Hard Drives A+ Guide to Hardware: Managing, Maintaining, and Troubleshooting, 5e Chapter 6 Supporting Hard Drives Objectives Learn about the technologies used inside a hard drive and how data is organized on the drive

More information

System and Algorithmic Adaptation for Flash

System and Algorithmic Adaptation for Flash System and Algorithmic Adaptation for Flash The FAWN Perspective David G. Andersen, Vijay Vasudevan, Michael Kaminsky* Amar Phanishayee, Jason Franklin, Iulian Moraru, Lawrence Tan Carnegie Mellon University

More information

ZFS STORAGE POOL LAYOUT. Storage and Servers Driven by Open Source.

ZFS STORAGE POOL LAYOUT. Storage and Servers Driven by Open Source. ZFS STORAGE POOL LAYOUT Storage and Servers Driven by Open Source marketing@ixsystems.com CONTENTS 1 Introduction and Executive Summary 2 Striped vdev 3 Mirrored vdev 4 RAIDZ vdev 5 Examples by Workload

More information