Chris Moultrie Dr. Prasad CSc 8350 [17] S. Gurumurthi, A. Sivasubramaniam, M. Kandemir, and H. Franke, "DRPM: dynamic speed control for power
|
|
- Abner Stevenson
- 6 years ago
- Views:
Transcription
1 [1] This paper outlines different strategies for a new, improved version of raid named EERaid. They were able to produce savings of 60% and 70% of the energy used in typical RAID setups while keeping the efficiency on the same level as that of DPRM. They outline different setups based on current RAID striping such as RAID 0,1,5,10,50, etc. Very informative paper with good information. [2] This paper states a high performance (approaching performance of RAID 5) algorithm that is more fault tolerant than other RAID options. This involves multiple layers of RAID controllers and a variable number of disks. One master RAID controller has multiple RAID controllers set up in RAID 5 with each secondary controller attached to disks also in RAID 5. Faster and more reliable, but not more power efficient. [3] This paper outlines a model in which a manager dolls out resources to the users based on the client's bid for services. Those who bid higher get more resources, these resources are all scaled dynamically based on current server load. Outlines a complex cost equation and some energy saving benefits such as powering down (sleeping) nodes that are not currently needed, but waking them up when they are needed. [4] FAWN attempts to conserve energy with flash memory and low powered CPUs lacking L2/ L3 cache. They claim savings of 2 orders of magnitude of power for requests versus standard magnetic drives. They also claim that with less of the CPU taken up by L2/L3 cache there is more room so more processing power for simple actions like retrieving data. [5] This paper outlines 4 approaches to reducing the power consumption by disks. The first three show no real gain, but the fourth models a drive of varying speed so that it can be sped up for periods of high activity and slowed down for periods of low activity. They show 20% drop in power usage by this method. [6] A method for using redundancy in disks while saving energy. This method employs keeping one of two drives in a low-power state until one of three conditions are met: 1. high volume of accesses, 2. when disks fail, 3. at interval periods for syncing the two disks. While they see a savings of 27-60% the major issue seems to be data integrity. If the disk holding the log of the most current changes dies before the predetermined sync time, those changes would be lost. As it is not power efficient (currently) to power drives down for less than 30 seconds [reference to come later], this means potentially long periods of time without updates losing one of the important qualities of redundancy in disks. [7] Taking a different path, this paper aims to analyze the reliability of two types of parallel disk arrays: MAID and PDC. They introduce a new model for determining the life expectancy of drives and introduce methods for saving energy and extending the life of drives at the same time. Keeping drives out of landfills and using less energy at the same time offers great promise, but nothing was implemented besides their model for determining the life of drives. [8]While not able to realize significant gains (greater than 20%) in most simulations, this article's ideas warrant a closer look into possible modifications and adoption into current disk prefetching schemes. Banking on the unquoted statistic that applications use 20% of the data available 80%
2 of the time they believe they can of energy savings of 12-26%. This seems unlikely to be the case in a real world scenario since the 20% in the buffer is not enough for all data accesses and the 20% of the time spent accessing data is not shifted to one side or the other, but interspersed randomly across the log of accesses. [9] Buffered Disks is a popular topic and in this paper the authors were able to realize power savings of 38%. The idea behind the buffered disks in this paper has four tiers. There is a main BUD controller driving the entire system, below it is the buffered cache, which is in front of the buffered disks, which all sit in front of the data disks. Writes are sent down the aforementioned path and are sent to the first available spots each time. This ensures no data is waiting for a write while there are idle drives that could process it. Data in the cache (once loaded) is almost immediately written to avoid loss and preserve integrity. [10] This paper delves into compiler based organization of data on striped disks. This enables the compiler to inspect the program, determine the best size for pieces of data and splits them across the disks in round robin fashion accordingly. The only possible drawbacks I see are bringing a fully accepted compiler to the market that does not slow down considerably compile time. The technique of allowing the compiler to arrange the disk layout is capable of being combined with DRPM and other hardware energy saving techniques for an even larger gain. [11] The authors have developed a model for determining the reliability of power saving methods in parallel disk setups. This is a very important idea that has been overlooked by many researchers. In their model they determine (using Markov process) the reliability based on factors such as switching power modes and varying RPM while leaving the model open to other methods that may come. Mean Time To Data Loss and Mean Time To Failure are both important statistics determined in this paper. This model is excellent for determining the feasibility and usefulness of a power saving scheme on parallel disks. [12] MINT is a reliability model for disks, the authors in this paper take MINT and utilize it for reliability of multi-disk arrays (specifically MAID and PDC) using common power saving features such as varying voltage frequency and multi-rpm disks. Their study results in a model useful for many parallel disk systems, using data obtained from other studies, which can determine the average lifespan of disks based on their usage and configuration. [13] This is another compiler derived energy saving technique developed to work in combination with hardware techniques for saving energy. The authors achieved the best energy savings when using DRPM in conjunction with their interprocessor code-restructuring approach that schedules the code to be executed considering the disk layout information. Inter-P-TPM had an experimental savings of 43%, which was the best of the models tested. [14] Here, the idea of utilizing multiple arms simultaneously inside of a single disk to seek data is explored in detail. Many tests and comparisons are done to determine the benefits including a cost analysis based on the prices of current parts for disks. The higher cost of the disk is then compared to the energy savings gained by using such a disk. The intra-disk parallelism here shows great promise in the simulations and modeling but such a drive has not been produced since 1980 and that disk was considered to be too costly for the benefits achieved. Real data
3 from different organizations based on their type of disk seeks was used to evaluate the performance gains of the Intra-Disk Parallelism. DASH Taxonomy was also introduced in this paper. [15] HYBUD is a hybrid of two data storage schemes, non-volatile flash storage and buffered disks. Although flash storage is expensive using a small amount of it in a buffered disk architecture will mitigate the cost and improve energy usage. Requests will first go to the flash memory, then to the buffered disks and finally the data disks. The majority of the time the data disks will be in suspended mode because much of the frequently used data will be cached in one of the storage solutions ahead of it. Flash is a good first-buffer because it has very quick read times, but has slower write times which is why it is not as good for permanent storage. [16]This paper outlines a different BUD architecture (PREBUD) where a future window is developed to gather a list of data blocks that will be accessed in the future. The buffered disks then pre-fetch the blocks that are expected to be used before they are requested, leaving the data disks to be in a low power state for longer if the future window only includes blocks that are currently on the buffer disks. This scheme also differs from other prefetching schemes in that it pre-fetches data with consideration of the energy usage it will cause. It will combine requests for data to maximize the length of time that the data disk stays in low powered mode. Buffered disks (if too busy from too many requests) may be bypassed to achieve faster data retrieval times. [17]The strategy employed in this paper is called DRPM. Dynamic RPM scaling is similar to TPM (traditional power management) in that disks power is lowered with lower usage. However, unlike TPM which only has 3 states (only 1 for data seeking): in-use, idle, and suspended, DRPM has multiple usable power states based on the amount of power given to the spindle to raise or lower RPM of the platter. While a lower RPM will lower the speed of the response to the request for data, it is the authors' contention that this is negligible and only matters for a high volume of seeks, which would then incur a higher speed of the spindle. Much time is spent analyzing the performance and power cost however not much is spent in regards to the reliability of such a system, which warrants further study. [18] This paper outlines a scheme for conserving energy based on DVS (dynamic voltage scaling) coupled with an expected retrieval time of the data. The user makes a request, and the expected answer time is calculated and the request is distributed across the disk array. If there are enough requests that the request time will not be fulfilled, then the controller will scale up the voltage to the array so that they will seek the data quicker, but if there are few requests then voltage can be scaled down. [19] Hibernator was able to realize energy savings of up to 65% versus standard RAID 5 configurations without DRPM. This system uses a corse grained approach to sleeping and waking the drives which should extend the life of the drives as there are a finite number of starts and stops that a disk can handle. This setup was also able to give soft guarantees for response times whereas DRPM and PDC were not able to come close to the requested response time. Hibernator also dynamically shifts data across the array to provide faster accesses and a more
4 balanced load to save energy. Hibernator is a very advanced, well thought out compilation of some different schemes plus some original ones. [1] D. Li and J. Wang, "EERAID: energy efficient redundant and inexpensive disk array," ACM SIGOPS European Workshop, [2] S.H. Baek, B.W. Kim, E.J. Joung, and C.W. Park, "Reliability and Performance of Hierarchical RAID with," Electronics, 2001, pp [3] J.S. Chase, D.C. Anderson, P.N. Thakar, A.M. Vahdat, and R.P. Doyle, "Managing energy and server resources in hosting centers," ACM SIGOPS Operating Systems Review, vol. 35, 2001, p [4] D. Andersen, J. Franklin, M. Kaminsky, A. Phanishayee, L. Tan, and V. Vasudevan, "FAWN: A fast array of wimpy nodes," Proceedings of the ACM SIGOPS 22nd symposium on Operating systems principles, ACM, 2009, p. 1â14. [5] E. Carrera, E. Pinheiro, and R. Bianchini, "Conserving disk energy in network servers," Proceedings of the 17th annual international conference on Supercomputing, ACM, 2003, p. 97. [6] E. Pinheiro and R. Bianchini, "Exploiting Redundancy to Conserve Energy," Energy, pp [7] S. Yin, X. Ruan, A. Manzanares, Z. Ding, J. Xie, J. Majors, and X. Qin, "Improving Reliability of Energy-Efficient Parallel Storage Systems by Disk Swapping," Structure, 2009, pp [8] A. Manzanares, K. Bellam, and X. Qin, "A Prefetching Scheme for Energy Conservation in Parallel Disk Systems," Proc. NSF Next Generation Software Program Workshop, April, [9] Z. Zong, M. Briggs, N. O'Connor, and X. Qin, "An Energy-Efficient Framework for Large- Scale Parallel Storage Systems," IEEE International Parallel and Distributed Processing Symposium, IPDPS 2007, 2007, p [10] S. Son, G. Chen, M. Kandemir, and A. Choudhary, "Exposing disk layout to compiler for reducing energy consumption of parallel disk based systems," Proceedings of the tenth ACM SIGPLAN symposium on Principles and practice of parallel programming, ACM, 2005, p [11] F. Shen, X. Qin, A. Salazar, A. Manzanares, and K. Bellam, "An Energy-Efficient Reliability Model for Parallel Disk Systems," 2009 Sixth International Conference on Information Technology: New Generations, 2009, pp [12] S. Yin, X. Ruan, A. Manzanares, and X. Qin, "How reliable are parallel disk systems when energy-saving schemes are involved," in Proc. IEEE International Conference on Cluster Computing (CLUSTER, [13] S. Woo Son, G. Chen, O. Ozturk, M. Kandemir, and A. Choudhary, "Compiler-Directed Energy Optimization for Parallel Disk Based Systems," IEEE Transactions on Parallel and Distributed Systems, vol. 18, 2007, pp [14] S. Sankar, S. Gurumurthi, and M. Stan, "Intra-disk parallelism: an idea whose time has come," ACM SIGARCH Computer Architecture News, vol. 36, 2008, p [15] M. Nijim, A. Manzanares, X. Ruan, and X. Qin, "HYBUD: An Energy-Efficient Architecture for Hybrid Parallel Disk Systems," 2009 Proceedings of 18th International Conference on Computer Communications and Networks, vol , 2009, pp [16] A. Manzanres, X. Ruan, S. Yin, M. Nijim, W. Luo, and X. Qin, "Energy-Aware Prefetching for Parallel Disk Systems: Algorithms, Models, and Evaluation," 2009 Eighth IEEE International Symposium on Network Computing and Applications, 2009, pp
5 [17] S. Gurumurthi, A. Sivasubramaniam, M. Kandemir, and H. Franke, "DRPM: dynamic speed control for power management in server class disks," Proceedings of the 30th annual international symposium on Computer architecture, ACM, 2003, p [18] M. Nijim, A. Manzanares, and X. Qin, "An Adaptive Energy-Conserving Strategy for Parallel Disk Systems," th IEEE/ACM International Symposium on Distributed Simulation and Real-Time Applications, 2008, pp [19] Q. Zhu, Z. Chen, L. Tan, Y. Zhou, K. Keeton, and J. Wilkes, "Hibernator: helping disk arrays sleep through the winter," Proceedings of the twentieth ACM symposium on Operating systems principles, ACM, 2005, p. 190.
Energy-Aware Prefetching for Parallel Disk Systems
2009 Eighth IEEE International Symposium on Network Computing and Applications Energy-Aware Prefetching for Parallel Disk Systems Algorithms, Models, and Evaluation Adam Manzanres, Xiaoun Ruan, Shu Yin,
More informationStorage Devices for Database Systems
Storage Devices for Database Systems 5DV120 Database System Principles Umeå University Department of Computing Science Stephen J. Hegner hegner@cs.umu.se http://www.cs.umu.se/~hegner Storage Devices for
More informationContents. Memory System Overview Cache Memory. Internal Memory. Virtual Memory. Memory Hierarchy. Registers In CPU Internal or Main memory
Memory Hierarchy Contents Memory System Overview Cache Memory Internal Memory External Memory Virtual Memory Memory Hierarchy Registers In CPU Internal or Main memory Cache RAM External memory Backing
More informationEnergy Conservation In Computational Grids
Energy Conservation In Computational Grids Monika Yadav 1 and Sudheer Katta 2 and M. R. Bhujade 3 1 Department of Computer Science and Engineering, IIT Bombay monika@cse.iitb.ac.in 2 Department of Electrical
More informationPower and Locality Aware Request Distribution Technical Report Heungki Lee, Gopinath Vageesan and Eun Jung Kim Texas A&M University College Station
Power and Locality Aware Request Distribution Technical Report Heungki Lee, Gopinath Vageesan and Eun Jung Kim Texas A&M University College Station Abstract With the growing use of cluster systems in file
More informationDynamic Power-Aware Disk Storage Management in Database Servers
Dynamic Power-Aware Disk Storage Management in Database Servers Peyman Behzadnia 1, Wei Yuan 2, Bo Zeng 3, Yi-Cheng Tu 1( ), and Xiaorui Wang 4 1 Department of Computer Science and Engineering, University
More informationCSCI-GA Operating Systems. I/O : Disk Scheduling and RAID. Hubertus Franke
CSCI-GA.2250-001 Operating Systems I/O : Disk Scheduling and RAID Hubertus Franke frankeh@cs.nyu.edu Disks Scheduling Abstracted by OS as files A Conventional Hard Disk (Magnetic) Structure Hard Disk
More informationMIND: A Black-Box Energy Consumption Model for Disk Arrays
MIND: A Black-Box Energy Consumption Model for Disk Arrays Zhuo Liu 1,2, Jian Zhou 1, Weikuan Yu 2, Fei Wu 1, Xiao Qin 2, and Changsheng Xie 1 1 Wuhan National Laboratory for Optoelectronics 1 Key Laboratory
More informationDatabase Management Systems, 2nd edition, Raghu Ramakrishnan, Johannes Gehrke, McGraw-Hill
Lecture Handout Database Management System Lecture No. 34 Reading Material Database Management Systems, 2nd edition, Raghu Ramakrishnan, Johannes Gehrke, McGraw-Hill Modern Database Management, Fred McFadden,
More informationSoftware-Directed Disk Power Management for Scientific Applications
Software-Directed Disk Power Management for Scientific Applications S. W. Son M. Kandemir CSE Department Pennsylvania State University University Park, PA 16802, USA {sson,kandemir}@cse.psu.edu A. Choudhary
More informationChapter 6 - External Memory
Chapter 6 - External Memory Luis Tarrataca luis.tarrataca@gmail.com CEFET-RJ L. Tarrataca Chapter 6 - External Memory 1 / 66 Table of Contents I 1 Motivation 2 Magnetic Disks Write Mechanism Read Mechanism
More informationDatabase Systems II. Secondary Storage
Database Systems II Secondary Storage CMPT 454, Simon Fraser University, Fall 2009, Martin Ester 29 The Memory Hierarchy Swapping, Main-memory DBMS s Tertiary Storage: Tape, Network Backup 3,200 MB/s (DDR-SDRAM
More informationLecture 23: Storage Systems. Topics: disk access, bus design, evaluation metrics, RAID (Sections )
Lecture 23: Storage Systems Topics: disk access, bus design, evaluation metrics, RAID (Sections 7.1-7.9) 1 Role of I/O Activities external to the CPU are typically orders of magnitude slower Example: while
More informationHyBuM: Energy-Efficient Hybrid Mobile Storage Systems using Solid States and Buffer Disks Mais Nijim (corresponding author), Ashraf yaseen
Computer Communication & Collaboration (Vol. 3, Issue 4, 2015) ISSN 2292-1028(Print) 2292-1036(Online) Submitted on Aug. 31, 2015 (DOIC: 2292-1036-2015-04-001-59) HyBuM: Energy-Efficient Hybrid Mobile
More informationI/O CANNOT BE IGNORED
LECTURE 13 I/O I/O CANNOT BE IGNORED Assume a program requires 100 seconds, 90 seconds for main memory, 10 seconds for I/O. Assume main memory access improves by ~10% per year and I/O remains the same.
More informationAutomated Storage Tiering on Infortrend s ESVA Storage Systems
Automated Storage Tiering on Infortrend s ESVA Storage Systems White paper Abstract This white paper introduces automated storage tiering on Infortrend s ESVA storage arrays. Storage tiering can generate
More informationVirtual Memory. Reading. Sections 5.4, 5.5, 5.6, 5.8, 5.10 (2) Lecture notes from MKP and S. Yalamanchili
Virtual Memory Lecture notes from MKP and S. Yalamanchili Sections 5.4, 5.5, 5.6, 5.8, 5.10 Reading (2) 1 The Memory Hierarchy ALU registers Cache Memory Memory Memory Managed by the compiler Memory Managed
More informationA New High-performance, Energy-efficient Replication Storage System with Reliability Guarantee
A New High-performance, Energy-efficient Replication Storage System with Reliability Guarantee Jiguang Wan 1, Chao Yin 1, Jun Wang 2 and Changsheng Xie 1 1 Wuhan National Laboratory for Optoelectronics,
More informationData Storage and Query Answering. Data Storage and Disk Structure (2)
Data Storage and Query Answering Data Storage and Disk Structure (2) Review: The Memory Hierarchy Swapping, Main-memory DBMS s Tertiary Storage: Tape, Network Backup 3,200 MB/s (DDR-SDRAM @200MHz) 6,400
More informationChapter 1: Introduction. Operating System Concepts 9 th Edit9on
Chapter 1: Introduction Operating System Concepts 9 th Edit9on Silberschatz, Galvin and Gagne 2013 Objectives To describe the basic organization of computer systems To provide a grand tour of the major
More informationAdministrivia. CMSC 411 Computer Systems Architecture Lecture 19 Storage Systems, cont. Disks (cont.) Disks - review
Administrivia CMSC 411 Computer Systems Architecture Lecture 19 Storage Systems, cont. Homework #4 due Thursday answers posted soon after Exam #2 on Thursday, April 24 on memory hierarchy (Unit 4) and
More informationLecture 25: Interconnection Networks, Disks. Topics: flow control, router microarchitecture, RAID
Lecture 25: Interconnection Networks, Disks Topics: flow control, router microarchitecture, RAID 1 Virtual Channel Flow Control Each switch has multiple virtual channels per phys. channel Each virtual
More informationFAWN. A Fast Array of Wimpy Nodes. David Andersen, Jason Franklin, Michael Kaminsky*, Amar Phanishayee, Lawrence Tan, Vijay Vasudevan
FAWN A Fast Array of Wimpy Nodes David Andersen, Jason Franklin, Michael Kaminsky*, Amar Phanishayee, Lawrence Tan, Vijay Vasudevan Carnegie Mellon University *Intel Labs Pittsburgh Energy in computing
More informationRAID SEMINAR REPORT /09/2004 Asha.P.M NO: 612 S7 ECE
RAID SEMINAR REPORT 2004 Submitted on: Submitted by: 24/09/2004 Asha.P.M NO: 612 S7 ECE CONTENTS 1. Introduction 1 2. The array and RAID controller concept 2 2.1. Mirroring 3 2.2. Parity 5 2.3. Error correcting
More informationCS5460: Operating Systems Lecture 20: File System Reliability
CS5460: Operating Systems Lecture 20: File System Reliability File System Optimizations Modern Historic Technique Disk buffer cache Aggregated disk I/O Prefetching Disk head scheduling Disk interleaving
More informationA Reliable B-Tree Implementation over Flash Memory
A Reliable B-Tree Implementation over Flash Xiaoyan Xiang, Lihua Yue, Zhanzhan Liu, Peng Wei Department of Computer Science and Technology University of Science and Technology of China, Hefei, P.R.China
More informationC 1. Recap. CSE 486/586 Distributed Systems Distributed File Systems. Traditional Distributed File Systems. Local File Systems.
Recap CSE 486/586 Distributed Systems Distributed File Systems Optimistic quorum Distributed transactions with replication One copy serializability Primary copy replication Read-one/write-all replication
More informationFangyang Shen* and Andres Salazar
240 Int. J. High Performance Systems Architecture, Vol. 2, Nos. 3/4, 2010 A reliability model of energy-efficient parallel disk systems with data mirroring Fangyang Shen* and Andres Salazar Department
More informationRAID. Redundant Array of Inexpensive Disks. Industry tends to use Independent Disks
RAID Chapter 5 1 RAID Redundant Array of Inexpensive Disks Industry tends to use Independent Disks Idea: Use multiple disks to parallelise Disk I/O for better performance Use multiple redundant disks for
More informationBBM371- Data Management. Lecture 2: Storage Devices
BBM371- Data Management Lecture 2: Storage Devices 18.10.2018 Memory Hierarchy cache Main memory disk Optical storage Tapes V NV Traveling the hierarchy: 1. speed ( higher=faster) 2. cost (lower=cheaper)
More informationOperating system Dr. Shroouq J.
2.2.2 DMA Structure In a simple terminal-input driver, when a line is to be read from the terminal, the first character typed is sent to the computer. When that character is received, the asynchronous-communication
More informationECE Enterprise Storage Architecture. Fall 2018
ECE590-03 Enterprise Storage Architecture Fall 2018 RAID Tyler Bletsch Duke University Slides include material from Vince Freeh (NCSU) A case for redundant arrays of inexpensive disks Circa late 80s..
More informationI/O Hardwares. Some typical device, network, and data base rates
Input/Output 1 I/O Hardwares Some typical device, network, and data base rates 2 Device Controllers I/O devices have components: mechanical component electronic component The electronic component is the
More informationDelayed Partial Parity Scheme for Reliable and High-Performance Flash Memory SSD
Delayed Partial Parity Scheme for Reliable and High-Performance Flash Memory SSD Soojun Im School of ICE Sungkyunkwan University Suwon, Korea Email: lang33@skku.edu Dongkun Shin School of ICE Sungkyunkwan
More informationFAWN as a Service. 1 Introduction. Jintian Liang CS244B December 13, 2017
Liang 1 Jintian Liang CS244B December 13, 2017 1 Introduction FAWN as a Service FAWN, an acronym for Fast Array of Wimpy Nodes, is a distributed cluster of inexpensive nodes designed to give users a view
More informationk -bit address bus n-bit data bus Control lines ( R W, MFC, etc.)
THE MEMORY SYSTEM SOME BASIC CONCEPTS Maximum size of the Main Memory byte-addressable CPU-Main Memory Connection, Processor MAR MDR k -bit address bus n-bit data bus Memory Up to 2 k addressable locations
More informationAdvanced Database Systems
Lecture II Storage Layer Kyumars Sheykh Esmaili Course s Syllabus Core Topics Storage Layer Query Processing and Optimization Transaction Management and Recovery Advanced Topics Cloud Computing and Web
More informationSF-LRU Cache Replacement Algorithm
SF-LRU Cache Replacement Algorithm Jaafar Alghazo, Adil Akaaboune, Nazeih Botros Southern Illinois University at Carbondale Department of Electrical and Computer Engineering Carbondale, IL 6291 alghazo@siu.edu,
More informationDynamic Buffer Allocation for Conserving Disk Energy in Clustered Video Servers Which Use Replication
Dynamic Buffer Allocation for Conserving Dis Energy in Clustered Video Servers Which Use Replication Minseo Song School of Computer Science and Engineering, Inha University, Korea mong@inha.ac.r Abstract.
More informationChapter 1: Introduction. Operating System Concepts 8th Edition,
Chapter 1: Introduction, Administrivia Reading: Chapter 1. Next time: Continued Grand Tour. 1.2 Outline Common computer system devices. Parallelism within an operating system. Interrupts. Storage operation,
More informationLecture 29. Friday, March 23 CS 470 Operating Systems - Lecture 29 1
Lecture 29 Reminder: Homework 7 is due on Monday at class time for Exam 2 review; no late work accepted. Reminder: Exam 2 is on Wednesday. Exam 2 review sheet is posted. Questions? Friday, March 23 CS
More informationI/O Management and Disk Scheduling. Chapter 11
I/O Management and Disk Scheduling Chapter 11 Categories of I/O Devices Human readable used to communicate with the user video display terminals keyboard mouse printer Categories of I/O Devices Machine
More informationInput/Output Management
Chapter 11 Input/Output Management This could be the messiest aspect of an operating system. There are just too much stuff involved, it is difficult to develop a uniform and consistent theory to cover
More informationIs Traditional Power Management + Prefetching == DRPM for Server Disks?
Is Traditional Power Management + Prefetching == DRPM for Server Disks? Vivek Natarajan Sudhanva Gurumurthi Anand Sivasubramaniam Department of Computer Science and Engineering, The Pennsylvania State
More informationAnnouncement. Computer Architecture (CSC-3501) Lecture 20 (08 April 2008) Chapter 6 Objectives. 6.1 Introduction. 6.
Announcement Computer Architecture (CSC-350) Lecture 0 (08 April 008) Seung-Jong Park (Jay) http://www.csc.lsu.edu/~sjpark Chapter 6 Objectives 6. Introduction Master the concepts of hierarchical memory
More informationDynamic Compilation for Reducing Energy Consumption of I/O-Intensive Applications
Dynamic Compilation for Reducing Energy Consumption of I/O-Intensive Applications Seung Woo Son 1, Guangyu Chen 1, Mahmut Kandemir 1, and Alok Choudhary 2 1 Pennsylvania State University, University Park
More informationVirtual Machines. 2 Disco: Running Commodity Operating Systems on Scalable Multiprocessors([1])
EE392C: Advanced Topics in Computer Architecture Lecture #10 Polymorphic Processors Stanford University Thursday, 8 May 2003 Virtual Machines Lecture #10: Thursday, 1 May 2003 Lecturer: Jayanth Gummaraju,
More informationAppendix D: Storage Systems
Appendix D: Storage Systems Instructor: Josep Torrellas CS433 Copyright Josep Torrellas 1999, 2001, 2002, 2013 1 Storage Systems : Disks Used for long term storage of files temporarily store parts of pgm
More informationSoftware Pipelining for Coarse-Grained Reconfigurable Instruction Set Processors
Software Pipelining for Coarse-Grained Reconfigurable Instruction Set Processors Francisco Barat, Murali Jayapala, Pieter Op de Beeck and Geert Deconinck K.U.Leuven, Belgium. {f-barat, j4murali}@ieee.org,
More informationProfessor: Pete Keleher! Closures, candidate keys, canonical covers etc! Armstrong axioms!
Professor: Pete Keleher! keleher@cs.umd.edu! } Mechanisms and definitions to work with FDs! Closures, candidate keys, canonical covers etc! Armstrong axioms! } Decompositions! Loss-less decompositions,
More informationComputer Architecture 计算机体系结构. Lecture 6. Data Storage and I/O 第六讲 数据存储和输入输出. Chao Li, PhD. 李超博士
Computer Architecture 计算机体系结构 Lecture 6. Data Storage and I/O 第六讲 数据存储和输入输出 Chao Li, PhD. 李超博士 SJTU-SE346, Spring 2018 Review Memory hierarchy Cache and virtual memory Locality principle Miss cache, victim
More informationStorage Systems. Storage Systems
Storage Systems Storage Systems We already know about four levels of storage: Registers Cache Memory Disk But we've been a little vague on how these devices are interconnected In this unit, we study Input/output
More informationPerformance of relational database management
Building a 3-D DRAM Architecture for Optimum Cost/Performance By Gene Bowles and Duke Lambert As systems increase in performance and power, magnetic disk storage speeds have lagged behind. But using solidstate
More information5.11 Parallelism and Memory Hierarchy: Redundant Arrays of Inexpensive Disks 485.e1
5.11 Parallelism and Memory Hierarchy: Redundant Arrays of Inexpensive Disks 485.e1 5.11 Parallelism and Memory Hierarchy: Redundant Arrays of Inexpensive Disks Amdahl s law in Chapter 1 reminds us that
More informationCMSC 424 Database design Lecture 12 Storage. Mihai Pop
CMSC 424 Database design Lecture 12 Storage Mihai Pop Administrative Office hours tomorrow @ 10 Midterms are in solutions for part C will be posted later this week Project partners I have an odd number
More informationDemand fetching is commonly employed to bring the data
Proceedings of 2nd Annual Conference on Theoretical and Applied Computer Science, November 2010, Stillwater, OK 14 Markov Prediction Scheme for Cache Prefetching Pranav Pathak, Mehedi Sarwar, Sohum Sohoni
More informationCOMP283-Lecture 3 Applied Database Management
COMP283-Lecture 3 Applied Database Management Introduction DB Design Continued Disk Sizing Disk Types & Controllers DB Capacity 1 COMP283-Lecture 3 DB Storage: Linear Growth Disk space requirements increases
More informationStorage systems. Computer Systems Architecture CMSC 411 Unit 6 Storage Systems. (Hard) Disks. Disk and Tape Technologies. Disks (cont.
Computer Systems Architecture CMSC 4 Unit 6 Storage Systems Alan Sussman November 23, 2004 Storage systems We already know about four levels of storage: registers cache memory disk but we've been a little
More informationFundamentals of Quantitative Design and Analysis
Fundamentals of Quantitative Design and Analysis Dr. Jiang Li Adapted from the slides provided by the authors Computer Technology Performance improvements: Improvements in semiconductor technology Feature
More informationI/O CANNOT BE IGNORED
LECTURE 13 I/O I/O CANNOT BE IGNORED Assume a program requires 100 seconds, 90 seconds for main memory, 10 seconds for I/O. Assume main memory access improves by ~10% per year and I/O remains the same.
More informationRAID (Redundant Array of Inexpensive Disks)
Magnetic Disk Characteristics I/O Connection Structure Types of Buses Cache & I/O I/O Performance Metrics I/O System Modeling Using Queuing Theory Designing an I/O System RAID (Redundant Array of Inexpensive
More informationMonday, May 4, Discs RAID: Introduction Error detection and correction Error detection: Simple parity Error correction: Hamming Codes
Monday, May 4, 2015 Topics for today Secondary memory Discs RAID: Introduction Error detection and correction Error detection: Simple parity Error correction: Hamming Codes Storage management (Chapter
More informationThe Use of Cloud Computing Resources in an HPC Environment
The Use of Cloud Computing Resources in an HPC Environment Bill, Labate, UCLA Office of Information Technology Prakashan Korambath, UCLA Institute for Digital Research & Education Cloud computing becomes
More informationLinux Software RAID Level 0 Technique for High Performance Computing by using PCI-Express based SSD
Linux Software RAID Level Technique for High Performance Computing by using PCI-Express based SSD Jae Gi Son, Taegyeong Kim, Kuk Jin Jang, *Hyedong Jung Department of Industrial Convergence, Korea Electronics
More informationDepartment of Information Technology Sri Venkateshwara College of Engineering, Chennai, India. 1 2
Energy-Aware Scheduling Using Workload Consolidation Techniques in Cloud Environment 1 Sridharshini V, 2 V.M.Sivagami 1 PG Scholar, 2 Associate Professor Department of Information Technology Sri Venkateshwara
More informationECE331: Hardware Organization and Design
ECE331: Hardware Organization and Design Lecture 29: an Introduction to Virtual Memory Adapted from Computer Organization and Design, Patterson & Hennessy, UCB Overview Virtual memory used to protect applications
More informationEDUCATION RESEARCH EXPERIENCE
PERSONAL Name: Mais Nijim Gender: Female Address: 901 walkway, apartment A1 Socorro, NM 87801 Email: mais@cs.nmt.edu Phone: (505)517-0150 (505)650-0400 RESEARCH INTEREST Computer Architecture Storage Systems
More informationCPSC 421 Database Management Systems. Lecture 11: Storage and File Organization
CPSC 421 Database Management Systems Lecture 11: Storage and File Organization * Some material adapted from R. Ramakrishnan, L. Delcambre, and B. Ludaescher Today s Agenda Start on Database Internals:
More informationLecture 18: Memory Systems. Spring 2018 Jason Tang
Lecture 18: Memory Systems Spring 2018 Jason Tang 1 Topics Memory hierarchy Memory operations Cache basics 2 Computer Organization Computer Processor Memory Devices Control Datapath Input Output So far,
More informationA Data Centered Approach for Cache Partitioning in Embedded Real- Time Database System
A Data Centered Approach for Cache Partitioning in Embedded Real- Time Database System HU WEI, CHEN TIANZHOU, SHI QINGSONG, JIANG NING College of Computer Science Zhejiang University College of Computer
More informationChapter 11. I/O Management and Disk Scheduling
Operating System Chapter 11. I/O Management and Disk Scheduling Lynn Choi School of Electrical Engineering Categories of I/O Devices I/O devices can be grouped into 3 categories Human readable devices
More informationEastern Mediterranean University School of Computing and Technology CACHE MEMORY. Computer memory is organized into a hierarchy.
Eastern Mediterranean University School of Computing and Technology ITEC255 Computer Organization & Architecture CACHE MEMORY Introduction Computer memory is organized into a hierarchy. At the highest
More informationMemory. Objectives. Introduction. 6.2 Types of Memory
Memory Objectives Master the concepts of hierarchical memory organization. Understand how each level of memory contributes to system performance, and how the performance is measured. Master the concepts
More informationChapter 6 Objectives
Chapter 6 Memory Chapter 6 Objectives Basic memory concepts, such as RAM and the various memory devices Master the concepts of hierarchical memory organization. Understand how each level of memory contributes
More informationReal-time grid computing for financial applications
CNR-INFM Democritos and EGRID project E-mail: cozzini@democritos.it Riccardo di Meo, Ezio Corso EGRID project ICTP E-mail: {dimeo,ecorso}@egrid.it We describe the porting of a test case financial application
More informationDynamic Data Placement Strategy in MapReduce-styled Data Processing Platform Hua-Ci WANG 1,a,*, Cai CHEN 2,b,*, Yi LIANG 3,c
2016 Joint International Conference on Service Science, Management and Engineering (SSME 2016) and International Conference on Information Science and Technology (IST 2016) ISBN: 978-1-60595-379-3 Dynamic
More informationChapter 11: File System Implementation. Objectives
Chapter 11: File System Implementation Objectives To describe the details of implementing local file systems and directory structures To describe the implementation of remote file systems To discuss block
More informationDatabase Systems. November 2, 2011 Lecture #7. topobo (mit)
Database Systems November 2, 2011 Lecture #7 1 topobo (mit) 1 Announcement Assignment #2 due today Assignment #3 out today & due on 11/16. Midterm exam in class next week. Cover Chapters 1, 2,
More informationFile Structures and Indexing
File Structures and Indexing CPS352: Database Systems Simon Miner Gordon College Last Revised: 10/11/12 Agenda Check-in Database File Structures Indexing Database Design Tips Check-in Database File Structures
More informationECE7995 (3) Basis of Caching and Prefetching --- Locality
ECE7995 (3) Basis of Caching and Prefetching --- Locality 1 What s locality? Temporal locality is a property inherent to programs and independent of their execution environment. Temporal locality: the
More informationAssociate Professor Dr. Raed Ibraheem Hamed
Associate Professor Dr. Raed Ibraheem Hamed University of Human Development, College of Science and Technology Computer Science Department 2015 2016 1 Points to Cover Storing Data in a DBMS Primary Storage
More informationChe-Wei Chang Department of Computer Science and Information Engineering, Chang Gung University
Che-Wei Chang chewei@mail.cgu.edu.tw Department of Computer Science and Information Engineering, Chang Gung University l Chapter 10: File System l Chapter 11: Implementing File-Systems l Chapter 12: Mass-Storage
More informationBaoping Wang School of software, Nanyang Normal University, Nanyang , Henan, China
doi:10.21311/001.39.7.41 Implementation of Cache Schedule Strategy in Solid-state Disk Baoping Wang School of software, Nanyang Normal University, Nanyang 473061, Henan, China Chao Yin* School of Information
More informationWednesday, April 25, Discs RAID: Introduction Error detection and correction Error detection: Simple parity Error correction: Hamming Codes
Wednesday, April 25, 2018 Topics for today Secondary memory Discs RAID: Introduction Error detection and correction Error detection: Simple parity Error correction: Hamming Codes Storage management (Chapter
More informationUNIT I (Two Marks Questions & Answers)
UNIT I (Two Marks Questions & Answers) Discuss the different ways how instruction set architecture can be classified? Stack Architecture,Accumulator Architecture, Register-Memory Architecture,Register-
More informationLeveraging Disk Drive Acoustic Modes for Power Management
1 Leveraging Disk Drive Acoustic Modes for Power Management Doron Chen, George Goldberg, Roger Kahn, Ronen I. Kat, Kalman Meth {cdoron,georgeg,rogerk,ronenkat,meth}@il.ibm.com IBM Research - Haifa, Israel
More informationA Data Centered Approach for Cache Partitioning in Embedded Real- Time Database System
A Data Centered Approach for Cache Partitioning in Embedded Real- Time Database System HU WEI CHEN TIANZHOU SHI QINGSONG JIANG NING College of Computer Science Zhejiang University College of Computer Science
More informationIntroduction to Parallel Processing
Babylon University College of Information Technology Software Department Introduction to Parallel Processing By Single processor supercomputers have achieved great speeds and have been pushing hardware
More informationCS 525M Mobile and Ubiquitous Computing Seminar. Michael Theriault
CS 525M Mobile and Ubiquitous Computing Seminar Michael Theriault Software Strategies for Portable Computer Energy Management Paper by Jacob R. Lorch and Alan J. Smith at the University of California In
More informationAll-Flash Storage Solution for SAP HANA:
All-Flash Storage Solution for SAP HANA: Storage Considerations using SanDisk Solid State Devices WHITE PAPER Western Digital Technologies, Inc. 951 SanDisk Drive, Milpitas, CA 95035 www.sandisk.com Table
More informationStoring Data: Disks and Files. Storing and Retrieving Data. Why Not Store Everything in Main Memory? Chapter 7
Storing : Disks and Files Chapter 7 base Management Systems, R. Ramakrishnan and J. Gehrke 1 Storing and Retrieving base Management Systems need to: Store large volumes of data Store data reliably (so
More informationPrinciples of Data Management. Lecture #2 (Storing Data: Disks and Files)
Principles of Data Management Lecture #2 (Storing Data: Disks and Files) Instructor: Mike Carey mjcarey@ics.uci.edu Database Management Systems 3ed, R. Ramakrishnan and J. Gehrke 1 Today s Topics v Today
More informationHow to Apply the Geospatial Data Abstraction Library (GDAL) Properly to Parallel Geospatial Raster I/O?
bs_bs_banner Short Technical Note Transactions in GIS, 2014, 18(6): 950 957 How to Apply the Geospatial Data Abstraction Library (GDAL) Properly to Parallel Geospatial Raster I/O? Cheng-Zhi Qin,* Li-Jun
More informationWilliam Stallings Computer Organization and Architecture 8th Edition. Cache Memory
William Stallings Computer Organization and Architecture 8th Edition Chapter 4 Cache Memory Characteristics Location Capacity Unit of transfer Access method Performance Physical type Physical characteristics
More informationIntroduction to I/O. April 30, Howard Huang 1
Introduction to I/O Where does the data for our CPU and memory come from or go to? Computers communicate with the outside world via I/O devices. Input devices supply computers with data to operate on.
More informationELE580A: Green Information Technology (Fall 2010) Instructor: Professor Margaret Martonosi
ELE580A: Green Information Technology (Fall 2010) Instructor: Professor Margaret Martonosi mrm@princeton.edu Where to find stuff: All course information, schedule, and links to class readings will be available
More informationStoring and Retrieving Data. Storing Data: Disks and Files. Solution 1: Techniques for making disks faster. Disks. Why Not Store Everything in Tapes?
Storing and Retrieving Storing : Disks and Files Chapter 9 base Management Systems need to: Store large volumes of data Store data reliably (so that data is not lost!) Retrieve data efficiently Alternatives
More informationA+ Guide to Hardware: Managing, Maintaining, and Troubleshooting, 5e. Chapter 6 Supporting Hard Drives
A+ Guide to Hardware: Managing, Maintaining, and Troubleshooting, 5e Chapter 6 Supporting Hard Drives Objectives Learn about the technologies used inside a hard drive and how data is organized on the drive
More informationSystem and Algorithmic Adaptation for Flash
System and Algorithmic Adaptation for Flash The FAWN Perspective David G. Andersen, Vijay Vasudevan, Michael Kaminsky* Amar Phanishayee, Jason Franklin, Iulian Moraru, Lawrence Tan Carnegie Mellon University
More informationZFS STORAGE POOL LAYOUT. Storage and Servers Driven by Open Source.
ZFS STORAGE POOL LAYOUT Storage and Servers Driven by Open Source marketing@ixsystems.com CONTENTS 1 Introduction and Executive Summary 2 Striped vdev 3 Mirrored vdev 4 RAIDZ vdev 5 Examples by Workload
More information